Memory That Brings Entropy Back ✎

Original: "Relative Entropy Revivals Caused by Memory-Induced Loss of Divisibility in Classical Non-Markovian Dynamics"
· Koichi Nakagawa
arXiv:2602.09054 · 2026-02-07 · arXiv non-exclusive · independent analysis · 2 min
When a system remembers its past, its path to equilibrium can briefly run in reverse.

The orchestra starts playing in unison, but a hidden conductor changes the direction of the baton for a second. In the same way, a system striving toward equilibrium suddenly takes a step back.

In Markovian processes, where the future depends only on the present, the distance to equilibrium, measured by relative entropy, decreases monotonically, like sand in an hourglass. But if a system remembers its history, that arrow of time can waver. Such revivals of entropy had been noticed before, but no one understood what minimal mechanism causes them.

Memory here is like a hidden conductor: it does not change the notes, but it delays some strokes of the baton. Because of this, the orchestra momentarily loses the rhythm, even though the score remains the same.

The author built the simplest models with two and three states and an exponential memory kernel. It turned out that when the memory time is comparable to the relaxation time, the effective generator acquires negative off-diagonal elements. This means a loss of stochastic divisibility: the evolution can no longer be split into successive Markovian steps. Then the standard proof of monotonicity stops working, and relative entropy can temporarily grow, producing an overshoot.

A numerical experiment showed that with short memory the dynamics is almost Markovian, and entropy decreases. With long memory, delayed feedback from a hidden variable temporarily reverses relaxation, like a conductor who momentarily turns the orchestra back.

In the two-state model, the overshoot appears as an oscillatory transient whose amplitude grows as the memory time increases. In the three-state model, phase diagrams clearly separate the regimes, and the boundary corresponds to the estimate γ ~ λ. This confirms that the entropy overshoot is a robust consequence of the loss of divisibility, not an artifact of special initial conditions.

The orchestra is playing in unison again. But now it is clear that the brief stumble was not an accident, but the work of memory, which for a moment returned the system to its past.

In the Markovian case, relative entropy acts as a Lyapunov function that guarantees an irreversible approach to equilibrium. A loss of divisibility means the evolution cannot be split into successive Markovian steps, and then the familiar arrow of time can briefly turn backwards.

\frac{dP(t)}{dt} = \int_0^t K(t-\tau) P(\tau) d\tau
The rate of change of the probabilities at time t depends on the entire previous history through the kernel K.
K(t) = \gamma e^{-\gamma t} R
Memory decays exponentially at rate γ, while R is the Markovian generator.
F(t) = D_{KL}(P(t) \| \pi) = \sum_i P_i(t) \ln \frac{P_i(t)}{\pi_i}
A measure of the information distance of the current distribution from the stationary one, π.
Scientists
Ludwig BoltzmannRudolf ClausiusJacob BekensteinStephen HawkingJames Clerk MaxwellEdward Witten
Concepts
boltzmann entropy entropy entropic gravity arrow of time Markov chain relaxation damping rate energy gap relaxation time logarithmic correction irreversibility entropic shadow