The ability of a model to perform well on new, unseen data rather than just the training examples.Generalization is the ability of a model — whether a neural network or a biological brain — to perform well on new, unseen data, rather than merely memorizing the training examples it was shown. It is the core goal of any learning system: a model that only works on its training set has not truly learned the underlying pattern, but has instead overfit to noise or specific quirks of the data. In physics and machine learning, generalization is what allows a network trained on a limited set of measurements to predict outcomes for entirely new conditions, such as mapping dark matter distributions from gravitational lensing or predicting the behavior of quantum states of light.
The concept was formalized in the 1960s and 1970s within statistical learning theory, notably by Vladimir Vapnik and Alexey Chervonenkis, who introduced the Vapnik-Chervonenkis (VC) dimension to quantify a model's capacity to generalize.
Generalization emerges when a model captures the underlying regularities of the data rather than its superficial details. This is achieved through techniques like regularization, cross-validation, and training on diverse datasets that force the model to find compact, reusable representations. In the brain, generalization is thought to rely on the formation of abstract maps or schemas that can be flexibly applied to new situations, as seen in studies of how the brain transfers past experiences to novel contexts. The key is that the model learns features that are genuinely predictive across a range of inputs, not just those that happen to fit the training examples.
Generalization is what makes neural networks useful in physics, from predicting gravitational lensing maps to classifying quantum states of light, and in medicine, where models trained on incomplete data must still make accurate predictions for new patients.
A model that perfectly memorizes its training data will almost always perform worse on new data than a simpler model that makes some errors on the training set — a phenomenon known as the bias-variance tradeoff.


















