The Brain Saves Memory Like a Cashier at Rush Hour express
A supermarket cashier at rush hour doesn't memorize every scanned item: they keep the running total in their head and watch the queue. The brain allocates its resources similarly: the expensive, precise cortex (responsible for deliberation) and the simpler, economical subcortical nuclei (where habits live) work in tandem. For a long time, it was thought that the cortex builds a map of the world, while the subcortex simply remembers where the reward is. But new work shows that when rewards change frequently, the cortex benefits from remembering not the rewards themselves but the general rules of the game.
This approach offers a new explanation for an old puzzle: why the cortex and subcortex seem to speak different languages during learning. The cortex picks out the general structure—'there's a pattern here'—while the subcortex notes: 'this is where they give candy.' When the world is unstable, the memory-limited cortex stops chasing every candy and becomes a strategist that learns rules, not facts.
The memory limit in the model was strict — only a few 'slots' for storing information. That was enough to remember either the exact coordinates of the reward or the general rule. In an unstable environment, the rule won, even if it caused the model to make occasional mistakes in the moment.
In 'The Matrix,' people learned instantly by uploading programs directly into their brains. This work suggests that the cortex might not just memorize data but absorb structure, like loading not a file but an operating system.