Why El Niño warms more than statistics say ✎

Original: "Direct and Indirect Effects -- An Information Theoretic Perspective"
arXiv:1912.10508 · 2019-12-22 · arXiv non-exclusive · independent analysis · 1 min
Standard measures average everything out, but a new method looks at a specific event and finds that El Niño's effect is three times larger than the average.

If one person wins the lottery, it is a huge event for them, but for all players combined it is almost imperceptible, because the average winnings per ticket remain a pittance. The same goes for climate: the El Niño phase does not happen often, but when it does, temperatures in the Pacific Northwest shift dramatically. Standard measures of causal effect average the influence over all phases, and the powerful El Niño effect drowns in the average, like one lucky winner's jackpot lost among a sea of losing tickets.

The new method does not look at the average winnings of all tickets, but at the winnings of the specific ticket that was drawn. This lets you measure the effect of a particular event, not a blurred average.

To measure the effect of a specific value, you compare two probability distributions. The first is the temperature distribution after you forcibly set the El Niño phase. The second is the usual distribution, averaged over all phases. The difference between them shows how strongly a particular event changes the picture. It turns out that El Niño's effect on temperature is about three times larger than the average effect across all phases. Moreover, the influence comes directly through the atmosphere, not through ocean memory. This approach helps not only in climate science, but also in neuroscience, where it is important to assess the impact of a specific stimulus on neural activity.

The mutual information between winning the lottery and spending is nearly zero, because the probability of winning is minuscule, although for a specific winner the effect is huge. Specific measures capture this contrast.

STE(x \to Y) = D(p(Y | \hat{x}) \| \sum_{x'} p(x') p(Y | \hat{x'}))
Kullback-Leibler divergence between the distribution of Y after forcing X=x and the distribution of Y averaged over all possible x.
SCDE(x \to Y; z) = D(p(Y | \hat{x}, \hat{z}) \| \sum_{x'} p(x') p(Y | \hat{x'}, \hat{z}))
Effect of X=x on Y when the mediator Z is fixed at Z=z.
SNIE(x \to Y) = D(p(Y | \hat{x}) \| \sum_{x',z'} p(x') p(z' | \hat{x'}) p(Y | \hat{x}, z'))
Effect of X=x on Y that is transmitted only through the mediator Z.
Concepts
IRI granger causality El Niño index information criterion El Niño relative ONI causality epidemic Southern Oscillation index Indian Ocean capacitor effect interannual variability seasonal forcing NOAA CPC Teleconnection information theory seasonal cycle forecast North Atlantic Oscillation linear inverse model ERSST