statistics

forecast skill

A measure of the accuracy of a forecast compared to a reference, such as climatology or persistence.
25 related articles

Description

Forecast skill is a way to score how much better a prediction is than a simple, cheap baseline. The baseline is often 'climatology' — just predicting the long-term average weather for that date — or 'persistence' — predicting that tomorrow will be like today. A forecast with high skill beats these naive guesses by a meaningful margin; a forecast with zero skill is no better than the baseline, and negative skill means it is worse.

How it works

Skill is usually expressed as a ratio or percentage comparing the forecast's error to the baseline's error. For example, the Brier skill score for probabilities or the mean squared error skill score for continuous values. If the forecast error is half the baseline error, the skill is 50%. This normalizes accuracy so you can compare forecasts across different places, seasons, or variables, where raw error alone would be misleading.

In practice

Meteorologists use skill scores to decide whether a new weather model is worth adopting, and climate scientists use them to validate seasonal predictions against a simple 'average year' forecast.

Fun fact

A forecast can be perfectly calibrated — meaning it is correct on average — yet have zero skill if it never beats the climatological baseline.

Concept graph →

Related articles · 25

Exoplanets2026-08-051 minarXiv:2608.05054express
Martian Weather, Earthly Playbook
Meteorologists have grown used to trusting neural networks: the GraphCast model predicts Earth's weather days ahead by drawing on global snapshots of the atmosphere. But this 'brain' can be transplanted to another planet — where the air is thin and the Sun warms differently.
Galaxies2026-07-183 minarXiv:2607.16763
Stellar Pinball: An Algorithm That Reads the Rules of Chaos
A hundred thousand stars in the dense core of a globular cluster move like steel balls in a giant pinball machine. Each 'bump' — a gravitational encounter between a binary system and a single star — triggers a cascade of unpredictable events.
eess.SY2026-07-161 minarXiv:2607.14606express
How to read an enemy in the sky in seconds
In combat, a pilot needs to instantly understand what an object is and what its intentions are. Conventional systems wait for complete radar data — like a goalkeeper who only reacts after the shot. The new algorithm works like an experienced goalkeeper: from the attacker's first moves, it predicts the target's maneuver.
How AI Quit Overreading
Code-writing assistants often behave like a chef who, to boil a single egg, rereads the whole cookbook. When asked to make a tiny fix, they reopen dozens of files and retrace long-familiar connections. This is unnecessary work — energy going to waste.
How the Brain Learns to Look Ahead
A melody plays, and the brain doesn't just listen note by note. It works like a conductor who already knows the score: each next note is expected because the previous ones still echo in memory. But how do neurons hold on to that echo?
Biological Physics2026-05-012 minarXiv:2605.00813express
Word Mosaic: How Physics Explains the Game of Scrabble
After a game of Scrabble, the board looks like a mosaic: tiles are scattered but form a connected pattern — islands of words in a sea of empty cells. Such a pattern can be described mathematically, but usually that requires complex rules.
The Artificial Scientist: Machine Minds That Still Can't Doubt
A lab assistant carefully follows every step of an experiment, but at the end, writes in the report what they wanted to write before they even started. That's how modern language models behave when given scientific research tasks.
Weather Forecast: Sharp Focus
The atmosphere is a chaotic system, and a detailed global forecast requires monstrous computing power. StretchCast sidesteps this by working like the human eye: it creates 'sharp vision' over a selected region with an ultra-fine grid, while seeing the rest of the world blurry, but sharp enough to capture global connections.
Machine Learning2026-03-222 minarXiv:2603.21284express
Weather forecast on a single GPU
Weather forecasting is like trying to predict where a rock will roll down a slope, knowing the shape of every bump and the force of the wind. Make a mistake at the start, and a week later that error grows into a full-blown storm. In the past, accurate forecasts required massive computers and days of computation.
Chaotic Dynamics2026-03-142 minarXiv:2603.13789express
Why Some Vortices Are Predictable and Others Aren't
In a turbulent flow, like a raging river, energy constantly cascades from large whirlpools to small ones. Occasionally, particularly powerful bursts occur, resembling sudden waves crashing against the shore. Scientists asked: can we know in advance when such a "wave" will strike? It turns out the answer depends on which vortices are present in the flow at that moment.
Stellar2026-03-051 minarXiv:2603.06712express
Solar Flares: Forecasting with Confidence
Solar flares — sudden energy releases on the Sun — can knock out satellites and power grids. Previous models often either cried wolf or missed a real blow. The fix: attach a reliability estimate to every prediction.
Machine Learning2026-02-212 minarXiv:2602.18679express
How a Neural Network Predicts the Unseen
Turbulent water flowing through a pipe and the swing of a pendulum may seem worlds apart. But they share something fundamental: both follow their own laws of motion, which can be described by numbers. A neural network trained on just one such 'dance of numbers' suddenly starts to understand another — without a single extra example.
The Gaze's Signature: How Eyes and Hand Agree on Timing
When the hand draws a line, the gaze almost always runs ahead, like a scout peeking around the corner before the column turns. But how far ahead? It turns out that each person has their own distance, and it does not change from attempt to attempt. In the experiment, professional calligraphers and ordinary people traced a contour on a screen while instruments recorded eye and pen movements.
Monsoon Receiver: How a Neural Network Finds Ocean Signals of Future Rains
Tuning an old radio receiver requires patience: you slowly turn the dial, catch a crackle, turn it again, until a voice emerges through the static. In much the same way, a reinforcement learning agent searched the ocean for two patches whose temperature difference best predicts rains in Thailand.
q-fin.PR2025-12-272 minarXiv:2512.22660
Climate in the Price of a Bond: How Machine Learning Predicts Catastrophe Bond Coupons
In 1992, Hurricane Andrew tore through Florida, leaving insurers with $$15.5 billion in losses. Many companies went bankrupt, and the market devised a way to shift disaster risk onto investors: catastrophe bonds. These securities pay generous coupons as long as a specified disaster does not occur, such as a hurricane of a certain strength or an earthquake in a particular region.
Cloud Spices: How a Neural Network Improves Climate
Climate forecasting is like a complex recipe: one wrong pinch and the whole dish is ruined. So it is with clouds — small but decisive. Climate models divide the sky into 50–100 km cells and don't see individual clouds. It's like throwing pepper by the handful when the recipe calls for a pinch.
A Ceiling of Randomness
Each Atlantic hurricane season is like a game of dice, where the number of spots depends on three major climate forces: El Niño, ocean temperature in the 'hurricane nursery,' and the North Atlantic Oscillation.
Neural Network Hears the Ocean's Whisper Three Months Before a Storm
Imagine an interpreter in a huge hall who hears not only the person next to them but also a whisper in the far corner, and from those fragments reconstructs the entire conversation. That's how the CAS-Canglong neural network works: it picks up connections between pressure, wind, and heat across the whole planet and uses them to predict what the ocean will look like three months from now.
West versus East: Who Really Drives El Niño
The Pacific Ocean spans half the planet, and its mood decides whether India gets rain or Australia gets drought. In the center of this giant, in a region that climatologists call NINO3.4, water temperatures rise and fall, affecting millions of lives.
Taming Chaos with Physics: Predicting Extreme Events from Sparse Data
Imagine a translator who learns the grammar of a chaotic language from textbook examples and then becomes fluent in real speech, complete with accents and noise. That is how the new KDL method works: first, a neural network is trained on synthetic data generated by the Liénard equation, then it is transferred to real time series where extreme events are rare and unpredictable.
Neural Network Learns from a Draft: How a Crude Model Helps Predict El Niño
An interpreter at an important negotiation keeps a draft of their speech at hand but checks against the live conversation as they go: if what is said diverges from the prepared text, they adjust the translation on the fly.
Why the February Monsoon Forecast Is Deceptively Accurate
Every year, farmers in southern India wait for the same thing: the sky to open up and the monsoon to arrive. Whether rice sprouts and whether there is enough water for the whole season depends on it. So the monsoon forecast is not abstract science but a matter of survival for hundreds of millions of people.
A Month Ahead: What Machine Learning Can Do for Weather Forecasts
A farmer in Iowa looks at the calendar: plant now or wait? In a month, a heat wave might strike, or rain might set in. Forecasters throw up their hands: the two-week forecast still holds, the seasonal one is out of reach, and in between lies a gap. The atmosphere changes too quickly to remember yesterday, and the ocean is too slow to come to the rescue.
Network Warns of El Niño a Year in Advance
In 2010, the Pacific Ocean was brewing a strong El Niño, but all forecasting models collectively overestimated it. They looked at water temperatures and missed the key point: the ocean had already begun to reorganize, not loudly but quietly, linking distant points in pairs.
Seasonal Forecasts for China's Energy Sector: Where the System Really Works
Picture a map of China with sparse green patches scattered across a yellow desert. Those patches are where the GloSea5 climate model can genuinely look three months ahead, while the desert is everything else, where its forecasts are no better than a coin toss.