Why the February Monsoon Forecast Is Deceptively Accurate ✎

Original: "Sensitivity of Indian summer monsoon rainfall forecast skill of CFSv2 model to initial conditions and the role of model biases"
arXiv:2101.07465 · 2021-01-19 · arXiv non-exclusive · independent analysis · 3 min
The CFSv2 model shows its best skill for forecasting the Indian monsoon when started in February, but the success is a fluke caused by a wrong La Niña prediction in 1983.

Every year, farmers in southern India wait for the same thing: the sky to open up and the monsoon to arrive. On it depends whether rice will sprout and whether there will be enough water for the whole season. So the monsoon forecast is not abstract science but a matter of survival for hundreds of millions of people. The CFSv2 model, used by meteorologists, has long been considered especially accurate when started in February. But new research shows that this accuracy is an illusion, born of a single lucky strike.

To understand what went wrong, picture a marksman aiming at a target, but his hand trembles. On one shot, the tremor accidentally compensates for his aiming error, and the bullet hits the bull's-eye. If you judge only by that shot, the marksman looks like a master. Similarly, in 1983 the model predicted La Niña, a cooling of the tropical Pacific, which never actually happened. But that wrong prediction accidentally matched real excess rainfall caused by a completely different mechanism: the positive phase of the Equatorial Indian Ocean Oscillation. One "lucky" miss inflated the average score of February forecasts.

Key number: the correlation between forecast and observations for February starts is 0.44, but if 1983 is excluded, it drops to 0.40. For April–May starts, the correlation without 1983 reaches 0.42.

When the researchers removed 1983 from the calculations, February's advantage evaporated. Moreover, other metrics, such as mean error, bias, and root mean square error, pointed from the start to April and May as giving more reliable forecasts. The problem is not statistics but the physics of the model. It ties rainfall too tightly to Pacific temperatures: in the model, the correlation between the NINO3.4 index and rainfall reaches -0.85, whereas in real observations it is only -0.44. The model seems to think that the monsoon is controlled solely by the Pacific, ignoring the Indian Ocean's own variability. As a result, it incorrectly links EQUINOO to ENSO and even flips the sign of the relationship between EQUINOO and rainfall: in the model the correlation is -0.77, while in observations it is +0.54.

EQUINOO refers to atmospheric oscillations over the equatorial Indian Ocean that directly affect the monsoon. In reality they are almost independent of El Niño, but the model forces a rigid link.

This physical distortion means that in years when the monsoon is driven by the Indian Ocean rather than the Pacific, the model is systematically wrong. And if you look only at correlation, these errors can be masked by chance coincidences, as happened in 1983. Operational centers should reconsider their choice of initial conditions: April–May starts give more stable results, and above all, the model itself needs fixing, reducing its excessive sensitivity to El Niño and the cold bias in the central Pacific.

The marksman from our analogy does not become a master from one lucky shot. Likewise, the model does not become better from one chance coincidence. To trust a forecast, you need to look not at individual hits but at how the marksman performs over a long distance, and then the February monsoon forecast turns out not to be a gold standard but a trap for the unwary.

In 1983, the CFSv2 model predicted a La Niña that never happened, but this erroneous forecast coincidentally matched the real excess rainfall, artificially inflating its skill score.

Concepts
monsoon onset spring predictability barrier interannual variability forecast skill monsoon Indian Ocean Dipole Multivariate ENSO Index Forecast lead Jin-Timmermann model ENSO tropospheric biennial oscillation