quantity

prediction error

A measure of how much a model's predictions differ from actual observed values.
28 related articles

Description

Prediction error is a statistical measure quantifying the discrepancy between a model's forecasts and actual observed outcomes. In physics and machine learning, it is the fundamental metric for evaluating how well a theory or algorithm captures reality. A low prediction error indicates that the model successfully extracts the underlying patterns from data, while a high error signals that the model is either too simplistic, overfitted, or missing key physical mechanisms.

History

The formal concept of prediction error emerged with the development of statistical learning theory in the mid-20th century, particularly through the work of Abraham Wald and later the PAC-learning framework of Leslie Valiant in the 1980s.

How it works

Prediction error is typically computed as a loss function, such as mean squared error or cross-entropy, which aggregates the differences between predicted values and ground truth across a dataset. In practice, models are trained by minimizing this error on a training set, then evaluated on a held-out test set to ensure they generalize. In physics, prediction error is used to validate theories against experimental data — for example, comparing simulated orbital trajectories to observed ones, or neural network predictions of molecular properties to quantum chemistry calculations.

In practice

Prediction error is used everywhere from weather forecasting (comparing predicted temperatures to actual readings) to medical diagnostics (assessing how accurately an AI predicts disease progression) and in physics simulations to tune models of complex systems like turbulence or nuclear structure.

Fun fact

In quantum chemistry, neural networks can now achieve prediction errors for molecular energies that are smaller than the chemical accuracy threshold of 1 kcal/mol, rivaling traditional ab initio methods at a fraction of the computational cost.

Concept graph →

Related articles · 28

q-bio.OT2026-08-282 minarXiv:2608.90074
How Long Do You Think You'll Live? The Accuracy of Subjective Longevity Forecasts Among Japanese People
Every one of us has wondered at least once how many years we'll live. In 1996, nearly two and a half thousand Japanese people over sixty answered that question in a national survey. Their answers became a kind of mirror reflecting hopes, fears, and habits of thought. Twenty-eight years later, researchers compared those forecasts with actual dates of death and found that the mirror was warped, but not useless.
A Diamond Compass That Learns on Its Own: Physics Inside a Neural Network
Diamond is not just a gemstone. Hidden inside its crystal lattice are defects that sense magnetic fields better than many instruments. One such defect, the NV center, acts as a tiny compass, but its needle wavers from heat and noise. For the compass to point accurately, calibration is needed.
Why Perovskite Solar Cells Age
A perovskite solar cell is like a young athlete: it performs brilliantly at first, but tires with age. Over eight hours, its performance drops noticeably, with no visible cause like cracks or dust. Scientists took one cell and recorded its performance at 0, 90, 280, and 480 minutes of its life.
q-bio.QM2026-08-092 minarXiv:2608.08916express
A Protein Orchestra Without a Conductor
As you slowly turn the tuning knob of an old radio, the sound doesn't fade in gradually from the static: it bursts forth in a sudden jump, the moment the antenna hits resonance with the wave. Genes in a living cell behave much the same way.
A Bias That Needs No Teacher
In a warehouse, there are boxes of apples and pears. There are many apples and few pears. But when the stock clerk says "a fruit with smooth skin," we are somehow more likely to recall the rare pear than the common apple. This is the inverse base-rate effect — a persistent glitch in how the brain resolves ambiguity between categories.
cs.HC2026-08-032 minarXiv:2608.01820express
Smartwatches vs. Sugar: Why the Accuracy Was a Mirage
A glucose meter that doesn't prick your finger but just looks at your wrist: that's the dream for millions of people with diabetes. It's the promise of algorithms that extract glucose levels from the ordinary pulse signal, the photoplethysmogram (the same one that measures heart rate in smartwatches).
math.NT2026-08-012 minarXiv:2608.00615express
Numbers Hide Patterns
In 1998, mathematician David Boyd noticed something strange. He was studying the Mahler measure of polynomials, a quantity that gauges the "complexity" of their roots, and found that for a family of curves, it always equals a special rational number times the derivative of an L-function.
Machine Learning2026-07-301 minarXiv:2607.27681express
Fractions of a Second That Prevent a Blackout
One hundred milliseconds. In that time, after a lightning strike or a short circuit, the power system either returns to normal operation or loses stability. A new-generation Neural Network Oscillations learns to sense this moment, like an experienced tightrope walker anticipating a gust of wind.
Sentinel with a Map: Hunting Free-Floating Planets
Two hundred million stars. In the heart of the Galaxy, where the future survey by the Nancy Grace Roman telescope will aim, about 250 times during its mission the light of one of them will flicker at an invisible touch.
Signal Processing2026-07-151 minarXiv:2607.13417express
Radio Waves Paint Portraits of Obstacles: How Diffraction and Fundamental Limits Reveal Hidden Objects
When a radio wave encounters a building in its path, it doesn't just reflect or get absorbed: it bends around it, much like ocean waves flowing around a rock, leaving calm water behind. In radiophysics, this phenomenon creates a radio shadow — a complex pattern of zones where the signal is amplified or attenuated, which scientists call a radio portrait.
q-bio.QM2026-07-151 minarXiv:2607.14404express
Noise in Proteins: How Randomness Governs the Cell
The cells of an organism are like twin chefs sharing a kitchen. They have the same cookbook (DNA), but when copying the recipe to a cheat sheet and assembling the dish, random errors occur. This unpredictability, entropy, means that in identical cells, protein levels are sometimes high, sometimes low.
Echo in the Labyrinth: Why Machine Learning Only Hears Echoes
Gravitational signals from dying massive stars are whispers reaching us from the most violent laboratories in the Universe. Einstein predicted these gravitational waves over a century ago, but only today, with detectors like LIGO, are we beginning to hear them.
How a neural network, reading weather backwards, warns of drought months in advance
At a weather station in Brazos County, Texas, rain is recorded on magnetic tape: every day, four years straight. Nine hundred millimeters in a good season, a hundred in a bad one. Then the tape falls silent. Drought creeps in without a sound — the slow fading of the earth's pulse. The standard SPI-3 index only catches on a month or two later, once the moisture is already gone.
Genes Speak Different Languages — A Neural Network Found a Common One
60 mice, 1,980 samples, 234 lung cancer patients. Behind each number lie thousands of genes. Their activity is measured to understand the disease. But the data aren’t uniform: for one patient, you assess a protein level (a continuous number), make a diagnosis (yes/no), and determine the tumor subtype (a category).
Breath of the Abyss: Neural Networks Listen to the Magnetic Sighs of Black Holes
A black hole is not a frozen void, but a living magnetic engine. Its 'heart'—the accretion disk, pulsates: inhale, matter spirals into the funnel, exhale — magnetic reconnection tears the field lines, and plasma shoots away from the horizon.
A Genetic Anchor for Health
You buy a new kitchen scale, but instead of exact weight, it only shows deviations from some "norm." To find out how much an apple weighs, you first have to weigh dozens of other apples and calculate the average.
Consciousness as a Thermostat Glitch
A thermostat keeps a room at 20 degrees. Open a window in winter, and it kicks on the heat to restore equilibrium. The brain does something similar: it constantly predicts what will happen a moment ahead and corrects itself when wrong. That's how it learns.
Chemical Physics2026-04-272 minarXiv:2604.24607express
How a Neural Network Learns from Quantum Chemistry's Mistakes
Quantum calculations are a recipe with perfect ingredients, but nature-the-chef cooks in her own way. Machine-learned models of atoms memorize the recipe and predict material properties in seconds instead of weeks.
Machine Learning2026-04-201 minarXiv:2604.18062express
Wings in a Minute: How AI Became an Aerodynamic Genius
Training an accurate aerodynamic model is like culinary art: first, a chef masters hundreds of recipes to grasp the general principles, then easily perfects a specific dish. Engineers created AeroTransformer and fed it 30,000 different wing shapes — a whole galaxy of culinary ideas galaxy.
Nuclear Theory2026-04-182 minarXiv:2604.16996express
How a neural network finds errors in physics textbooks
A uranium nucleus is like a tight wallet snapped shut on two halves. To make it burst and release energy (that is, to make the nucleus split) you have to climb over an energy barrier. The height of this threshold determines whether a substance is stable or ready to fall apart at any moment.
How a Warped Detector Catches Neutrinos
A giant sphere filled with liquid flashes when an elusive particle, a neutrino, flies through it. Inside the sphere, like fireflies on a Christmas tree, hang thousands of tubes that catch these flashes. To pinpoint exactly where the flash occurred and how much energy arrived, you need to know the position of each tube to within a millimeter.
The Prisoner's Paradox: The Old Bicycle of Classical Probability
Two accomplices are interrogated separately: betray or stay silent? If neither knows what the other will do, their choice breaks the classical rule of probability. It’s like riding an old bicycle over bumps — the hard seat jolts you off. The textbook rule, the classical model, fails. The authors of a new study found a simple fix: the cyclist needs a soft saddle.
HEP Phenomenology2026-01-131 minarXiv:2601.08813express
Machine Learns to See the Hidden
When a top quark is born in a particle detector, it immediately decays into a shower of other particles. Catching a hint of new physics in that shower is like hearing a whisper at a rock concert. You need not just a good microphone, but the ability to subtract the roar of the amplifiers and the hum of the crowd.
Machine Learning2026-01-012 minarXiv:2601.00175express
Computer Predicts Cirrhosis Two Years Ahead
The liver is a quiet workhorse. It processes everything we eat and drink, and rarely complains out loud. By the time the first obvious symptoms of cirrhosis appear, the disease has already destroyed a significant portion of the organ. Doctors have long sought a way to see into the liver's future, and a new study offers an unexpected tool — ordinary hospital records.
The Shadow of a Measured Value: How the EPR Paradox Dissolves in Operators
In 1935, Einstein, Podolsky, and Rosen proposed a thought experiment that, in their view, exposed the incompleteness of quantum mechanics. Two particles fly apart after interacting, and measuring the momentum of one instantly gives exact knowledge of the other's momentum.
A neural network trained on 127,137 years of model climate predicts winter
A translator who learned a language from thousands of books can interpret a conversation without being distracted by noise in the hall. Similarly, a neural network trained on 127,137 years of model climate produces a winter forecast in a fraction of a second, faster and more accurately than bulky dynamical systems.
A Probability Map for El Niño
Imagine a map where each patch of ocean is colored with its own shade: in some places the color is saturated, meaning the future of the system is predetermined; in others it is pale, meaning the outcome depends on a random gust of wind.
stat.ME2019-04-052 minarXiv:1904.02855
How to Make Your Model Pay for Its Mistakes
A translator who jumps at every rustle in the hall starts mixing up words by the end of the meeting. Their confidence in being right grows, while their accuracy drops. That is roughly how poorly calibrated probabilistic forecasts behave: the model claims a high probability for an event, but reality disagrees.