Weather forecast on a single GPU express

Original: "Sonny: Breaking the Compute Wall in Medium-Range Weather Forecasting"
· Minjong Cheon
arXiv:2603.21284 · 2026-03-22 · CC BY 4.0 · 2 min
The new model Sonny predicts weather a week ahead, training in just five and a half days on one graphics card.

Weather forecasting is like trying to predict where a rock will roll down a slope, knowing the shape of every bump and the force of the wind. Make a mistake at the start, and a week later that error grows into a full-blown storm. In the past, accurate forecasts required massive computers and days of computation. Now there's Sonny, a model that does the same on a single graphics card.

Sonny works in two steps. First, a narrow but deep layer tracks large-scale air movements, like an observer who sees the whole slope and understands the general direction of the rock. Then a wide layer adds details: heat, moisture, friction. This approach keeps the model from drowning in minutiae while not losing the big picture. To keep forecasts stable over long horizons, training uses a simple rule: the model constantly averages its parameters a bit, as if looking back at its past steps.

In tests, Sonny matches operational forecasting systems, and in the tropics over long lead times it even outperforms the similar FastNet model.

The tropics are the most capricious place for a forecaster. There, air is saturated with moisture, and the slightest nudge can spawn a typhoon. Sonny learned to spot such nascent vortices earlier than other lightweight models. This matters for countries where typhoons destroy homes and take lives every year.

Training Sonny takes about five and a half days on a single NVIDIA A40 GPU. For comparison, many modern models require hundreds of such cards and weeks of work.

The rock on the slope is the weather. Sonny doesn't just watch it; it understands how terrain irregularities and wind gusts will alter its path. And it does so so cheaply that even a small university group can now afford accurate forecasts.

A single NVIDIA A40 GPU draws about 300 watts, like three bright incandescent bulbs. Over the five and a half days of training, Sonny uses less electricity than a typical household refrigerator does in the same period.

In Ray Bradbury's story "A Sound of Thunder," a character changes the past, and it changes the weather. Sonny is a step toward predicting such changes, even when they come from the chaos of the atmosphere.

Concepts
forecast skill training learning rate supercomputer forecast transformers Machine Learning forecasting deep neural network IRI support vector machine lead time speech recognition heat engine reanalysis climate network ensemble forecast