Neural Networks Learn in Five Steps ✎ express

Original: "Implicitly Restarted Lanczos Enables Chemically-Accurate Shallow Neural Quantum States"
· Wei Liu, Wenjie Dou
arXiv:2601.01437 · 2026-01-04 · arXiv non-exclusive · independent analysis · 1 min
A new training method for neural networks in quantum chemistry achieves 10⁻¹² kcal/mol accuracy in just 3–5 steps.

📄 Showing the "Simple" version — "Advanced" is not ready yet. Add it to favorites to help prioritize it.

An ordinary neural network for quantum chemistry is like a student who learns from mistakes but keeps tripping over the same spot. It crawls toward the right answer, is sensitive to settings, and often loses stability.

For the fluorine molecule, the new method sped up calculations by 17,900 times compared to the popular Adam method.

Scientists proposed a different path: instead of picking the step size at random, they turn the training problem into finding the steepest descent on the error surface. The implicitly restarted Lanczos method solves a small but well-conditioned eigenvalue problem, as if finding the principal axis along which the error drops fastest. This automatically chooses both the direction and magnitude of the step, without manual tuning.

The result is impressive: even a simple neural network with few parameters achieves 10⁻¹² kcal/mol accuracy (that's like measuring the distance from Earth to the Moon to within a hair's width) in just 3–5 steps. This approach opens the door to accurate and fast calculations in quantum physics and chemistry.

An accuracy of 10⁻¹² kcal/mol is equivalent to measuring the distance from Earth to the Moon with an error smaller than the diameter of a human hair.

Scientists
Niels BohrPascual JordanWerner Heisenberg
Concepts
regularization methods renormalization quantum algorithm quantum computing resource optimization error suppression Recurrent Neural Networks