Imagine a large orchestra without a conductor. Each musician hears everyone else and adjusts to the collective hum. If every instrument amplifies its neighbors, the sound builds to a screech; if some occasionally dampen it, the orchestra may fall into silence or break into cacophony. Neural networks behave much the same way: connections between cells act as volume knobs, some boosting the signal, others turning it down.
For a long time, such balance was thought to be needed only to keep the network from "exploding" due to random outliers. But it turns out to change the very music. If neurons act as simple amplifiers, balance acts as a muffler: the network stays calm even with strong connections. If neurons saturate, like an overloaded microphone, balance instead cranks the volume up to chaos.
Experiments on virtual networks of a thousand neurons showed that for linear amplifiers, the critical connection strength at which activity explodes increased from 1.4 to 1.8 under full balance. For saturating neurons, balance turned a quiet network into a chaotic one, and the chaos dimension (the number of independent "voices" in the orchestra) first rose and then fell. Such a nonmonotonic response means balance is not just a switch but a fine-tuning knob.
Previously, researchers often assumed neurons have an odd activation function, meaning they respond symmetrically to plus and minus. That simplification masked the effect of balance. Now it is clear that in the real brain, where neurons saturate, the balance of excitation and inhibition can directly decide whether the network stays silent or generates complex activity. The orchestra without a conductor turns out to be sensitive to how exactly the musicians turn their volume knobs.
Under full balance (when the sum of incoming weights is zero), the time-averaged activity of each neuron in the network is strictly zero, even if the network is in a chaotic regime. This is analytically proven in the appendix of the paper.