Your hand rests on the table, and two short vibrations arrive at your wrist — one after the other. You need to say which is stronger. The task seems simple, but the answer depends on which vibration came first. If the first is weak and the second is strong, the difference feels larger than when they are swapped.
Spread a handful of coins on the table. Each coin is a possible outcome: heads, tails, or something else. If we know how chaotic this set is (its entropy), which combinations of probabilities will we encounter more often? It turns out the answer depends on how much chaos we allow.