When Disorder Gives Birth to Order ✎ express

Original: "Condensation Transition in Entropy-Constrained Probability Spaces"
arXiv:2605.08967 · 2026-05-09 · arXiv non-exclusive · independent analysis · 2 min
Probabilistic worlds collapse to a single point if they lack chaos.

Spread a handful of coins on the table. Each coin is a possible outcome: heads, tails, or something else. If we know how chaotic this set is (its entropy), which combinations of probabilities will we encounter more often? It turns out the answer depends on how much chaos we allow.

Entropy here is not just a measure of disorder but a way to say how many different outcomes can still materialize. Like a deck of cards: while the cards are shuffled, entropy is high; when all the aces are gathered in one player's hand, it drops.

The researchers took all possible probability distributions for K outcomes and fixed the entropy, as if we were to go through all the ways to distribute a unit sum of probabilities among K bins, but only those where the degree of mixing is the same. They applied a method akin to slicing the space into equilibrium pieces and discovered a sharp transition. When entropy falls below a critical threshold (approximately log K − 1 + 0.577), almost all distributions become "condensed": one bin takes the lion's share, while the rest split the meager crumbs equally.

The critical entropy behaves like the freezing point of water: just above, everything flows and mixes; just below, a solid structure emerges with one dominant center.

This sheds light on situations where complexity is limited. For example, in machine learning, a model might produce an overly confident prediction because its internal probability space spontaneously collapses to a single option. In ecology, a similar mechanism explains why a mature community often features one dominant species, with the rest forming a uniform background. Sparsity is not a whim but a natural consequence of entropic constraints in high-dimensional worlds.

The critical entropy below which everything collapses is approximately the logarithm of the number of outcomes minus 0.423—a number that appears in a wide range of problems, from packing spheres to energy distribution in gases.

In Stanisław Lem's novel "Solaris," the ocean might be experiencing something similar: its complexity is so vast that consciousness condenses into a single form inaccessible to human understanding.

Scientists
Claude ShannonJacob BekensteinWilhelm WienLudwig BoltzmannCharles BennettJohn von Neumann
Concepts
condensation probability distribution principle of maximum entropy contraction density superfluid density entropy chi squared distribution diffusion information spread evaporation probability theory condensate sample size phantom divide Bekenstein bound anderson darling test concentration first order phase transition standard deviation