How a Neural Network Discovered the Laws of Magnetism by Watching a Crowd ✛ ✦

Original: "Interpreting learning dynamics of autoencoders: Transient scaling and emerging concepts of the Ising model"
· Max Weinmann, Miriam Klopotek
arXiv:2607.10285 · 2026-07-11 · CC BY 4.0 · 1 min
An unsupervised program finds the overall direction and level of agreement in a system resembling a crowd with flags.

The neural network analyzed images resembling a top-down view of a square where thousands of people hold signal flags — up or down. The program compressed the picture into a few numbers and learned to reconstruct it. Without any instructions, it first detected the overall direction of the flags, and then how much neighbors agreed with each other. When two nearby people show different things, tension arises; when the same, harmony. This simple physics model is called the Ising model, and Ludwig Boltzmann derived the equilibrium law for such systems.

An unexpected twist: in complex neural networks, during rapid training, the program gets stuck at the first stage, never noticing conflicts. Such a breakdown resembles a phase transition studied by Lev Landau. Samples were generated using Roy Glauber's method.

This experiment demonstrates how artificial intelligence independently rediscovers fundamental concepts — a step towards programs capable of discovery. During learning, the network struggles with information chaos, akin to entropy in quantum thermodynamics.

The Ising model, invented for magnets, today describes everything — from neuron behavior to stock market price fluctuations.

E = -J \sum_{\langle ij\rangle} s_i s_j
Sum over neighboring pairs: aligned neighboring spins lower the energy.
p(s) = \frac{1}{Z} e^{-E/k_B T}
The higher the energy of a state, the less probable it is; Z is a normalization constant.
Scientists
Andrey Markov
Concepts
autoencoder self-supervised learning training learning training data ising model quantum ising model overfitting generalization emergent complexity modeling physics informed neural network parameter neural language acquisition agent Dynamical Systems classifier ai self correction stochastic dynamical system dataset machine learned interatomic potential