Blind Search for El Niño Precursors ✎

Original: "The Sampling Method for Optimal Precursors of ENSO Events"
· Bin Shi, Junjie Ma
arXiv:2308.13830 · 2023-08-26 · CC BY-NC-SA 4.0 · independent analysis · 2 min
A random sampling method finds the same optimal perturbations for the Zebiak–Cane model as a complex adjoint calculation, but five times faster.

A blindfolded sapper searches for a mine by tossing pebbles at random. He cannot see the map or calculate where the charge is buried. But if he throws enough pebbles and listens for which one lands with a duller thud, he can pinpoint the danger. That is roughly how a new method for predicting El Niño works: the warm current that every few years alters weather across the entire planet.

El Niño begins with a small warm patch in the Pacific Ocean. If that patch grows quickly, within months Australia faces drought and Peru gets rain. The forecaster's task is to find the exact initial patch that will develop into an event.

Previously, the adjoint method was used. It resembles an interpreter who listens to a speech while simultaneously translating it back into the original language to check every word. Such translation requires twice the effort and a separate model that can 'rewind' the calculation. For complex ocean and atmosphere models, building a reverse model is nearly impossible.

The new approach does away with the interpreter. Instead of an exact calculation, it runs random samples: the computer repeatedly tweaks the initial conditions and watches how fast the warm patch grows. Each sample is like a tossed pebble. From the sound of hundreds of pebbles, you can locate the mine without ever seeing it.

A test on the classic Zebiak–Cane model showed that the pattern of warm and cold patches matches that from the adjoint method. A warm patch of about 0.2 degrees in the eastern Pacific, a cold one in the center, and the thermocline dips by a hundred meters. The Niño 3.4 index dynamics over a year differ by less than a hundredth of a degree. Meanwhile, the calculation takes 3 seconds instead of 15: five times faster.

Cutting the number of samples from 1000 to 200 barely hurts the result. Accuracy drops from 98.7% to 91.5%, but the key features of the precursor remain. This matters because each sample is a separate run of the climate model.

The blind sapper has learned to find the mine faster than a sighted engineer with blueprints. And this skill is not limited to El Niño: the method can be applied to any forecast model where a reverse calculation is too complex. Pebbles tossed at random sometimes work better than exact formulas.

The sampling method is based on Stokes' theorem, which relates the integral over a volume to the integral over its boundary. Here, it allows replacing the gradient with an average of function values on a sphere: an elegant mathematical trick.

In Isaac Asimov's story 'The Last Question', a supercomputer searches for a way to reverse entropy by trying possibilities. The sampling method also tries random directions, but instead of an exhaustive search, it uses statistics to quickly find the optimal perturbation.

\nabla \hat{J}(u_0) = \frac{d}{\epsilon} \mathbb{E}_{v \in S^{d-1}} [J(u_0 + \epsilon v) v]
The gradient of the smoothed function equals the average over the sphere of the product of the function value and the direction, multiplied by the dimension and the inverse radius.
\nabla \hat{J}(u_0) \approx \frac{d}{n \epsilon} \sum_{i=1}^n [J(u_0 + \epsilon v_i) v_i]
The gradient is estimated as the arithmetic mean over n random directions, which avoids computing the exact gradient.
Concepts
zebiak cane model ENSO El Niño index Jin-Timmermann model spring predictability barrier Multivariate ENSO Index El Niño-Southern Oscillation Southern Oscillation NOAA CPC TAO/TRITON moorings La Niña ERSST NOAA PMEL / TAO relative ONI equatorial wave propagation forecast North Equatorial Countercurrent Warm water volume Monte Carlo methods ensemble forecast