The Neural Network's Treasure Map: Where El Niño Hides Its Predictability ✛

Original: "Explore the Ideology of Deep Learning in ENSO Forecasts"
arXiv:2601.02050 · 2026-01-05 · CC BY 4.0 · 3 min
A new method for explaining neural networks reveals where El Niño's predictability comes from and why spring forecasts remain weak.

The tropical Pacific Ocean heats and cools like a giant battery, and its rhythm affects weather from India to Canada. This rhythm is called El Niño–Southern Oscillation, or ENSO for short. Forecasting it months ahead is like predicting when a pot will boil without knowing the strength of the flame. Neural networks have learned to do this better than classical models, but their internal logic was hidden, like a map without labels. Now researchers have found a way to illuminate the places on that map where the network seeks predictive power.

For a forecast, the model receives data on sea surface temperature and heat content over three months. The task is to predict the Niño-3.4 index, that is, the average temperature in a specific region of the Pacific Ocean, up to 23 months ahead. First, the authors noticed that the network suffers from the 'vanishing gradient': many of its neurons get stuck in a state where training barely changes their behavior. To fix this, they inserted trainable parameters before the activation function, which calibrate the features, like a tuner adjusting strings before a concert.

The main tool of the study is the method of practical partial total variation (PPTV). It looks at how much the forecast changes when a given input variable is slightly altered. The larger the average change, the more important the variable.

Applying PPTV, the scientists obtained an importance map. For a one-month forecast, almost all attention is concentrated in the tropical Pacific. If the model is trained only on these data, accuracy barely drops. This confirms that the method indeed finds key regions. As lead time increases, attention spreads: first along latitude to tropical regions of the Indian and Atlantic Oceans, then becomes more diffuse. Regions south of 40°S always receive the least attention.

Channel-wise analysis showed that at short lead times, sea surface temperature is more important, while at long lead times, heat content, that is, heat stored in the upper ocean layers, matters more. In spring, the model expands its attention zone to all three tropical oceans, but forecast accuracy still declines. This points to limitations in the input data, not model errors. Such a conclusion links the spring predictability barrier to a lack of information.

The PPTV method has a rigorous mathematical foundation and does not require model modification. It can be applied to any model where one needs to understand the contribution of input variables.

The treasure map is now illuminated, but the treasure is not fully found. The spring barrier remains, and the authors suggest adding more ocean and atmosphere variables: wind, salinity. Perhaps then the network will find new landmarks, and forecasts will become more accurate even in the most capricious season.

The PPTV method is based on the concept of total variation of a function, which traces back to the work of Henri Lebesgue and is used in image processing for noise reduction. Here it is applied for the first time to explain neural networks in climatology.

PPTV(f|x_1) = \int \cdots \int_D P(x_1,\ldots,x_n) \left| \frac{\partial f}{\partial x_1} \right| dx_1 \cdots dx_n
The probability-weighted average of the absolute value of the partial derivative of the function with respect to variable x1, estimating its contribution to the change in output.
PPTV(f|x_1) \approx \frac{1}{m} \sum_{i=1}^m \left| \frac{\partial f(x_i)}{\partial x_i^1} \right|
Approximating the integral by the arithmetic mean of absolute gradients over training examples.
Concepts
spring predictability barrier ENSO El Niño index Jin-Timmermann model El Niño-Southern Oscillation Multivariate ENSO Index Southern Oscillation TAO/TRITON moorings equatorial wave propagation La Niña recharge oscillator model ERSST NOAA CPC NOAA PMEL / TAO Indian Ocean capacitor effect Warm water volume forecast Bjerknes feedback natural variability neural network regression