Balance of Connections Governs Chaos in Random Networks ✛ ✎

Original: "Local connectivity balance shapes population dynamics in random recurrent networks"
arXiv:2608.30008v1 · 2026-08-30 · arXiv non-exclusive · independent analysis · 4 min
Local balance of excitatory and inhibitory connections shifts network dynamics in opposite directions depending on the activation function's shape.

Context

This work sits at the fringe of the knowledge map: almost nothing nearby, with the nearest neighbor at distance 0.557. Nevertheless, surrounding works concern the brain, recurrent neural networks, and synapses: how the brain remembers after silence, how genes learn to play in time with chaos, why neurons cannot be friends with everyone. The common thread among these neighbors is an attempt to understand how connection structure gives rise to collective behavior. This paper fits into that thread but examines a parameter that neighbors did not touch: how precisely incoming signals to each neuron cancel each other. Previous works studied balance only as a way to remove outliers in the connectivity matrix spectrum, without asking whether it changes the dynamics itself.

Methods

The authors took the classical random recurrent network model of Sompolinsky and added one parameter: the degree of local balance. Each connection weight was redefined so that the sum of incoming weights to a node tends to zero under full balance. They then numerically simulated networks of one thousand and three thousand nodes with different activation functions: linear ReLU, quadratic superlinear, sigmoid, and sublinear. For analytical description, they used dynamical mean-field theory, deriving self-consistent equations via path integrals. Stability was assessed by the fraction of networks converging to a fixed point and by the maximal Lyapunov exponent.

Results

The effect of balance turned out to be opposite for different classes of activation functions. For linear ReLU and quadratic functions, balance suppressed divergence: under full balance, the critical connection strength after which activity explodes increased from 1.4 to 1.8. For sigmoid and sublinear functions, balance instead induced chaos: the maximal Lyapunov exponent grew monotonically with increasing balance. For odd functions, such as hyperbolic tangent, balance had no effect on dynamics. The reason is that for odd functions, the population-averaged activity is zero, and the self-generated input that balance removes vanishes by itself. For saturating functions, another surprise emerged: the effective dimensionality of dynamics, measured by the participation ratio, changed non-monotonically with increasing balance, peaking at an intermediate value.

Implications

The work shows that local balance of connections is not just a cosmetic fix to the spectrum but an independent control parameter of collective dynamics. It can either stabilize the network or throw it into chaos, depending on how the individual element is structured. This challenges the common assumption of odd activation functions, which masked the effect. For neuroscience, the result means that the excitation-inhibition balance observed experimentally in the cortex may directly influence whether the network is in a quiet or chaotic activity regime.

Future development

The topic could develop toward validation on real data. Large-scale connectomic datasets combining synaptic maps with activity recordings would allow estimating local balance by the number and size of synapses and comparing it with the dimensionality of population activity. An open question remains how well anatomical balance corresponds to effective balance of forces in the model, since a synapse's influence depends on its location on the dendrite and cell type. It would also be interesting to extend the analysis to networks with sparse connections and more realistic single-neuron dynamics.

Impact

The results directly affect computational neuroscience, the theory of recurrent neural networks, and the physics of disordered systems. They may also be useful in ecology and genetics, where similar models describe species communities and gene networks.

Next steps

The immediate next step is to test predictions on functional connectomics data, comparing anatomical balance with activity dimensionality. In theory, one should investigate how balance interacts with other structural features, such as sparsity or low-rank components.

Key open problems

The work connects to a long-standing problem in neuroscience: why cortical networks operate in a regime close to chaos but do not tip into it. The local excitation-inhibition balance studied here may be one mechanism keeping the network at the edge. It also contributes to understanding how anatomy determines computational properties of networks, which remains an open question.

The knowledge machine's view

This section is addressed to the author of the paper and their colleagues. Neighbouring works were found by meaning-based search across our archive, not by word overlap. We do not review: we show the field around the work.

What the work does

The authors took the classical Sompolinsky model of a random recurrent network and added a local balance parameter. Numerically and analytically, they showed that balance suppresses divergence for linear and superlinear activation functions, but induces chaos for saturating and sublinear ones, and has no effect on odd functions. They found a nonmonotonic change in effective dimensionality at intermediate balance.

Where its strength is

The work introduces local balance as an independent control parameter of dynamics, not just as a regularization of the spectrum. This opens a simple way to switch network activity regimes by changing a single parameter.

Where it could go next

Worth trying

  • Test adding time delays to the balanced model to see whether rhythmic patterns emerge.
  • Check whether balance can be used to control chaoticity in biological models with learning, for instance in the cellular orchestra model.
  • Investigate the effect of balance on the network's ability for associative recall, as in models of memory after silence.

Why this may matter

Excitation-inhibition balance is an experimentally observed property of cortical networks. Understanding how it governs dynamics could link structural measurements to functional brain states and help design recurrent neural networks with desired activity regimes.

Under full balance (when the sum of incoming weights is zero), the time-averaged activity of each neuron in the network is strictly zero, even if the network is in a chaotic regime. This is analytically proven in the appendix of the paper.

(1+\partial_t)x_i = \sum_{j=1}^N J_{ij}\phi(x_j)
The activity of each node changes under the sum of inputs from other nodes, transformed by the activation function.
J_{ij} = \bar{J}_{ij} - \frac{\mu}{N}\sum_{k=1}^N \bar{J}_{ik}
From the random weight, the row average multiplied by the balance parameter μ is subtracted. At μ=1, the sum of incoming weights is zero.
q = g^2 \left\{ \langle\langle \phi,\phi \rangle\rangle_{x\sim N(0,q)} + (1-\mu)^2 \langle \phi \rangle^2_{x\sim N(0,q)} \right\}
The variance of activity at the fixed point is determined by the sum of fluctuations and the square of the mean, with the mean contribution suppressed by balance.

Key numbers

  • critical connection strength for ReLU without balance: 1.4
  • critical connection strength for ReLU with full balance: 1.8
  • network size in simulations: 1000–3000 nodes
  • number of network realizations for stability assessment: 50
  • simulation duration for participation ratio: 100000 steps
Scientists
Albert Einstein
Concepts
collective behavior random network brain connectivity network weight brain rhythmic transport redundancy Recurrent Neural Networks emergent collective learning neural activity stochastic self organization ion channel dynamics nonlocality complex system dynamics power grid stabilization bottleneck effect feedback loop information storage log-normal distribution Braess's paradox in biology