A measure of how much a model's predictions differ from actual observed values.Prediction error is a statistical measure quantifying the discrepancy between a model's forecasts and actual observed outcomes. In physics and machine learning, it is the fundamental metric for evaluating how well a theory or algorithm captures reality. A low prediction error indicates that the model successfully extracts the underlying patterns from data, while a high error signals that the model is either too simplistic, overfitted, or missing key physical mechanisms.
The formal concept of prediction error emerged with the development of statistical learning theory in the mid-20th century, particularly through the work of Abraham Wald and later the PAC-learning framework of Leslie Valiant in the 1980s.
Prediction error is typically computed as a loss function, such as mean squared error or cross-entropy, which aggregates the differences between predicted values and ground truth across a dataset. In practice, models are trained by minimizing this error on a training set, then evaluated on a held-out test set to ensure they generalize. In physics, prediction error is used to validate theories against experimental data — for example, comparing simulated orbital trajectories to observed ones, or neural network predictions of molecular properties to quantum chemistry calculations.
Prediction error is used everywhere from weather forecasting (comparing predicted temperatures to actual readings) to medical diagnostics (assessing how accurately an AI predicts disease progression) and in physics simulations to tune models of complex systems like turbulence or nuclear structure.
In quantum chemistry, neural networks can now achieve prediction errors for molecular energies that are smaller than the chemical accuracy threshold of 1 kcal/mol, rivaling traditional ab initio methods at a fraction of the computational cost.











