How a Neural Network Learns to Hear Both the Words and the Intonation of Weather ✛ ✎

Original: "SFANet: Spatial-Frequency Attention Network for Weather Forecasting"
arXiv:2405.18849 · 2024-05-29 · arXiv non-exclusive · independent analysis · 1 min
The SFANet model looks at a precipitation map and its 'waves' at the same time to predict rain more accurately.

When a person listens to someone else's speech, they distinguish both the words and the intonation. If you remove either one, the meaning gets distorted. Weather forecasting works in a similar way: a satellite image contains both fine details, such as individual clouds, and large waves that span half a continent. Previously, neural networks were good at seeing either one or the other, but not both at once.

SFANet works like an attentive interpreter. First, it examines the image in parts, averaging neighboring patches so as not to get lost in details. Then it transforms the picture into another representation, where both large and small waves are visible, like in musical notation. Next, a special module compares the two 'translations' and decides which one to trust at each point.

For example, for drizzling rain, the overall picture is more important, while for thunderstorms, sharp contrasts matter. The attention module finds this balance on its own.

Thanks to this approach, the model with 16.4 million parameters predicts precipitation more accurately than heavier competitors. For El Niño, the warm current in the Pacific Ocean that affects weather worldwide, the improvement is 4.7%. This means forecasts will become more reliable, and computational resources will be needed no more than before.

The model uses the Fourier transform, which was invented by Jean-Baptiste Joseph Fourier in 1822 to describe heat propagation. Today it helps predict rain.

In Stanisław Lem's novel 'Solaris', the planet's ocean exhibits complex spatiotemporal dynamics that are difficult to predict. SFANet, by processing data in two domains, vaguely resembles an attempt to understand such systems through different representations.

Scientists
Niels BohrPascual JordanWerner HeisenbergJoseph Fourier
Concepts
climate network forecast ERA5 ENSO NOAA CPC ensemble forecast reanalysis attention mechanism neural networks in spatial mapping speech recognition spring predictability barrier zebiak cane model ERSST neural network El Niño-Southern Oscillation IRI Multivariate ENSO Index Jin-Timmermann model El Niño index solar flare prediction