Why the February Monsoon Forecast Is Deceptively Accurate ✎

Original: "Sensitivity of Indian summer monsoon rainfall forecast skill of CFSv2 model to initial conditions and the role of model biases"
arXiv:2101.07465 · 2021-01-19 · arXiv non-exclusive · independent analysis · 3 min
The CFSv2 model shows better skill for Indian monsoon forecasts starting in February, but the success is a fluke caused by a wrong La Niña prediction in 1983.

Every year, farmers in southern India wait for the same thing: the sky to open up and the monsoon to arrive. Whether rice sprouts and whether there is enough water for the whole season depends on it. So the monsoon forecast is not abstract science but a matter of survival for hundreds of millions of people. The CFSv2 model, used by meteorologists, has long been considered especially accurate when started in February. But new research shows that this accuracy is an illusion, born of a single lucky strike.

To understand what went wrong, picture a marksman aiming at a target, but his hand trembles. On one shot, the tremor accidentally compensates for the aiming error, and the bullet hits the bull's-eye. If you judge only by that shot, the marksman seems a master. Similarly, in 1983 the model predicted La Niña, a cooling of the tropical Pacific, which did not actually happen. But this erroneous prediction coincidentally matched the real excess rainfall caused by a completely different mechanism: the positive phase of the Equatorial Indian Ocean Oscillation. One "lucky" miss boosted the average score of February forecasts.

Key number: the correlation between forecast and observations for February starts is 0.44, but if 1983 is excluded, it drops to 0.40. For April–May starts, the correlation without 1983 reaches 0.42.

When the researchers removed 1983 from the calculations, February's advantage melted away. Moreover, other metrics, such as mean error, bias, and root mean square error, had pointed from the start to April and May giving more reliable forecasts. The problem is not statistics but the model's physics. It ties rainfall too strongly to Pacific temperatures: in the model, the correlation between the NINO3.4 index and rainfall reaches -0.85, whereas in real observations it is only -0.44. The model seems to think the monsoon is driven solely by the Pacific, ignoring the Indian Ocean's own variability. As a result, it incorrectly links EQUINOO to ENSO and even flips the sign of the relationship between EQUINOO and rainfall: in the model the correlation is -0.77, while in observations it is +0.54.

EQUINOO refers to atmospheric oscillations over the equatorial Indian Ocean that directly affect the monsoon. In reality they are almost independent of El Niño, but the model imposes a rigid link.

This physical bias means that in years when the monsoon is determined by the Indian Ocean rather than the Pacific, the model is systematically wrong. And if you look only at correlation, these errors can be masked by random coincidences, as in 1983. Operational centers should reconsider their choice of initial conditions: April–May starts give more stable results, and above all, the model itself needs fixing, reducing its excessive sensitivity to El Niño and the cold bias in the central Pacific.

The marksman in our analogy does not become a master from one lucky shot. Likewise, the model does not become better from one random coincidence. To trust a forecast, you need to look not at individual hits but at how the marksman performs over a long distance, and then the February monsoon forecast turns out to be not a gold standard but a trap for the unwary.

In 1983, the CFSv2 model predicted a La Niña that never happened, but this erroneous forecast coincidentally matched the real excess rainfall, artificially inflating its skill score.

Concepts
monsoon onset spring predictability barrier interannual variability forecast skill monsoon Indian Ocean Dipole Multivariate ENSO Index Forecast lead Jin-Timmermann model ENSO tropospheric biennial oscillation