concept

probability theory

Probability theory is the mathematical framework for analyzing random events and uncertainty.
15 related articles · 6 formulas · 1 who worked here

Description

Probability theory provides a way to measure uncertainty. It describes random phenomena — from pollen jittering in water (Brownian motion) to galaxy clusters. At its core is the probability space: a set of possible outcomes, each assigned a number from 0 to 1, and the sum of all equals 1. Conditional probability (the chance of an event given that another has occurred) refines our assumptions; Bayes' theorem flips the condition and updates probabilities with new data. This is the engine behind spam filters, medical diagnostics, and machine learning.

History

The formal study of probability began in the 17th century with the correspondence of Pascal and Fermat in 1654. Jacob Bernoulli's posthumous work 'Ars Conjectandi' (1713) introduced the law of large numbers. Thomas Bayes (1763) and Pierre-Simon Laplace formulated the principle of inverse probability — Bayes' theorem. In 1933, Andrey Kolmogorov, in 'Foundations of the Theory of Probability', axiomatized it on the basis of measure theory, linking pure mathematics with experience.

How it works

Probability theory works by specifying a sample space of elementary outcomes and a probability function. Rules — additivity for mutually exclusive events, multiplication for independent ones — allow computing probabilities of complex events. The law of large numbers guarantees that as the number of trials grows, the sample mean tends to the expected value. The central limit theorem states that sums of independent random variables are asymptotically normal, justifying frequentist statistics. Conditional probability and Bayes' theorem provide a mechanism for updating knowledge with incoming information. The apparatus of measure theory formalizes distributions via distribution functions, densities, or characteristic functions.

In practice

Insurance companies set policy prices, meteorologists report precipitation percentages, and doctors assess treatment risks — all based on probability calculations.

Fun fact

Shuffle a deck of 52 cards, and the resulting order is almost certainly unique in history. The number of permutations is so vast (8×10⁶⁷) that even if every person on Earth had been shuffling a deck every second since the Big Bang, we would be nowhere near repeating a combination.

Concept graph →

Formulas

$$\mathcal{L} = \prod_i \exp\left( -\frac{1}{2} \left[ \frac{f(x_i) - y_i}{\sigma_i} \right]^2 \right)$$
Probability of observed data given a model with Gaussian errors.
What is in the formula
f(x_i)variablemodel prediction at input x_i — function value
y_ivariableobserved data point — data value
σ_ivariablestandard deviation of measurement error — standard deviation
∏operatorProduct over all data points i — product operator
expoperatorExponential function — exponential function
\mathcal{l}_{\rmdesi}=\prod_i\exp(-\frac{1}{2}[\frac{f(x_i)-y_i}{σ_i}]) · 2601.06656
$$H(f) = \mathbb{E}[I(Y > \tilde{Y}) I(f(X) > f(\tilde{X}))]$$
Probability that predicted and observed orders agree.
What is in the formula
Hvariableconcordance probability — concordance probability
fvariablescoring function — function
Yvariableobserved response — response variable
Xvariableinput features — feature vector
Ỹvariableindependent copy of observed response — response variable
X̃variableindependent copy of input features — feature vector
Eoperatoraverages over the random variables — expectation operator
Ioperatorreturns 1 if condition true, 0 otherwise — indicator function
h(f_t)=\mathbb{e}_{x,\tilde{x},y,\tilde{y}}[i(y>\tilde{y})i(f_t(x)>f_t(\tilde{x}))] · 2607.00995
$$\log P(D|\theta) = -\frac{1}{2}\sum \left(\frac{(y_{\text{model}} - y_{\text{data}})^2}{\sigma^2} + \log(2\pi\sigma^2)\right)$$
Probability of data given model parameters with Gaussian errors.
What is in the formula
P(D|θ)variableprobability of data given parameters — probability
y_modelvariablemodel prediction — value
y_datavariableobserved data point — value
σvariablestandard deviation of Gaussian noise — standard deviation
logoperatornatural logarithm — logarithm
∑operatorsum over all data points — summation
\logp(d|θ)=-\frac{1}{2}\sum_{i=1}^n[\frac{(r_{\rmmodel}^{i}-r_{\rmdata}^{i})^2}{σ_{{\rmdata},i}^2+σ_{\rmsys}^2}+\log(2π(σ_{{\rmdata},i}^2+σ_{\rmsys}^2))] · 2607.05510v1
$$f(x) \propto x^{-k}$$
A probability distribution following a power law.
What is in the formula
fvariableprobability density function — probability density function
xvariablerandom variable — random variable
kvariablepower law exponent — power law exponent
f(v)\proptov^{-5} · 2601.03344v2
$$P = \sin^2(\theta)$$
Probability oscillates with a phase angle.
What is in the formula
Pvariableprobability of oscillation — probability
θvariablemixing angle or phase — phase angle radian
p_{garrowγ}=\sin^2(\frac{2\kappab_0q\sqrt{mn}l}{c}) · 2605.14050v1
$$S = -\sum_i p_i \ln p_i$$
Measure of uncertainty in a probability distribution.
What is in the formula
SvariableShannon entropy — entropy
p_ivariableProbability of the i-th outcome — probability
\sum_ioperatorSum over all possible outcomes i — summation
\lnoperatorNatural logarithm (base e) — natural logarithm
s=-\sum_ip_i\lnp_i · 2606.08686
h=-\sum_{i}p_i\log_2p_i · 2607.01833

Related articles · 34

Oblique Drop Impact: How Direction Decides the Fate of a Splash
A raindrop slides on the wind and hits the ocean not straight down but at an angle. At that moment, its energy splits into two channels: one pushes the water forward along the flight path, the other presses it downward into the depths. Which channel proves stronger determines what happens at the surface: a quiet submergence, a fan of spray to one side, or a crown that shatters in all directions.
Cosmology2026-07-163 minarXiv:2607.14525
Reading the Cosmic Palimpsest: Redshift Tomography of Unresolved Galaxies
The optical sky background is a cosmic palimpsest, where light from billions of unresolved galaxies is layered, each layer corresponding to a different epoch. Until now we could only distinguish the brightest "letters"—individual stars and nearby galaxies.
eess.SY2026-07-141 minarXiv:2607.12343express
How a Smart Algorithm Learns Not to Crash
A driver on a slippery road doesn't know exactly how the car will respond to the steering wheel, and learns on the go, leaving room for error. A smart control algorithm behaves in a similar way.
Statistical Mech2026-07-102 minarXiv:2607.09079express
Why Different Systems Behave the Same
A snowflake grows, an oil slick spreads, a crowd moves — each case has its own equations. But the end result is often the same: shape, speed, and pattern follow a simple scheme that repeats across scales. This is universality — when a common law hides behind the details.
Statistical Mech2026-07-102 minarXiv:2607.09416express
How Water Chooses Its Path Through Soil
Soil is not a solid sponge but a labyrinth of pores of various sizes. After rain, water does not fill them all at once: first the narrowest ones, then the wider ones. Physicists built a theory of this process based on a simple image — a set of communicating vessels.
math.GN2026-07-013 minarXiv:2607.01068
The Sieve of Infinity: How Q-spaces Intertwine with Measurable Cardinals
In mathematics there is a sieve that sifts not dust, but infinity itself. It’s called a Q-space: here any subset turns out to be a Gδ set — a countable intersection of open sets, as if sifted through an unimaginably fine mesh.
How Confirmation Bias Helps You Think Faster
We're used to thinking that noticing only confirmations of our guesses is a mistake. But recent calculations, inspired by wave behavior, flip that view. It turns out that the habit of seeking the familiar is the best way to reduce information noise (scientists call it entropy).
Quantum Physics2026-05-221 minarXiv:2605.23862express
Fuzzy Probabilities in a Blurry Spacetime
The quantum world is known for uncertainties: for example, you can't measure a particle's position and its speed at the same time. But new research shows that in a 'fuzzy' spacetime, even probability itself — the measure of chance — loses sharpness. A foggy compass doesn't give an exact direction: its needle wavers.
Space Physics2026-05-211 minarXiv:2605.24038express
Aurora Hunter: When the Sky Lights Up
The aurora borealis is like a distant theater: the show may be on, but whether the audience sees it depends on the curtain. Here, the curtain is clouds and moonlight. Earlier forecasts tried to predict both the occurrence of auroras and viewing conditions at once, mixing everything together.
General Relativity2026-05-151 minarXiv:2605.16150express
How the Universe is Born from Nothing
Quantum nothingness resembles water in a pot just before boiling. From time to time, a bubble spontaneously swells up — but not of steam, but of an entire universe. Such a bubble doesn't collapse; instead, it inflates into spacetime, triggering its own Big Bang. The only question is how often this happens.
Mesoscale2026-05-101 minarXiv:2605.09240express
The Elasticity Nobody Noticed
A rubber band stretches and snaps back. A steel spring compresses and expands. Elasticity seems like a property of simple things — a piece of metal or a drop of gel. But the authors of this work looked deeper. They showed that the electron's spin, its own tiny rotation, can also be elastic.
Statistical Mech2026-05-092 minarXiv:2605.08967express
When Disorder Gives Birth to Order
Spread a handful of coins on the table. Each coin is a possible outcome: heads, tails, or something else. If we know how chaotic this set is (its entropy), which combinations of probabilities will we encounter more often? It turns out the answer depends on how much chaos we allow.
Statistical Mech2026-05-092 minarXiv:2605.08860express
A Thermostat That Likes to Glue Probabilities Together
A pot of water on the stove eventually settles down: the temperature evens out, the liquid stops boiling. Physicists call this thermal equilibrium — a state where energy is distributed in the most probable way.
Physics and Society2026-04-252 minarXiv:2604.23337express
How a Nest Infects the Flock
Every group has its unspoken trios: three friends who are always together. And there are pairs that exist on their own. It turns out that how much trios "contain" pairs determines how everything, from a virus to a new idea, spreads through the group. Scientists introduced a measure they call the nesting coefficient.
Fluid Dynamics2026-04-211 minarXiv:2604.19458express
Turbulence as a Layered Cake
Water churns behind a rock in a river, air swirls behind an airplane wing: it seems like completely random motion. But the authors of the study found a rigid kitchen recipe in this chaos. They decomposed the fluid's rotation (angular momentum) into two independent parts.
Dynamical Systems2026-04-192 minarXiv:2604.17528express
Five Faces of the Same Randomness
In a big city after rain, water collects in the same low spots no matter where the first drops fall. An hour later, the pattern of puddles hardly depends on where the downpour started. That is equilibrium — the outcome a system reaches regardless of its start, once the details are forgotten.
Fluid Dynamics2026-04-122 minarXiv:2604.10491express
The Rain That Counts Its Drops
A raindrop falls into a puddle, and the impact sends up a little fountain of fine spray. Each of those droplets is a new, secondary drop. How many there are, how big they are, and how long they live depend on a host of factors: the fall speed, the drop size, the properties of the water. Scientists set out to make sense of this chaos using computer simulations.
Machine Learning2026-04-051 minarXiv:2604.04239express
Survival Prediction: Accuracy Isn't Confidence
A weather forecaster might correctly predict rain every day, but when he says "70% chance of precipitation," it actually rains only 30% of the time. His forecasts are useful, but the numbers can't be trusted. The same happens with models that predict cancer survival from tissue images and genetic data. Researchers tested 14 such models on data from five cancer types.
Nuclear Theory2026-03-301 minarXiv:2603.28599express
A Map for Atomic Nuclei
When a neutron or proton enters an atomic nucleus, it behaves like a ball hitting a rough wall: it can bounce off in different ways, depending on where it hits.
Fluid Dynamics2026-03-191 minarXiv:2603.18615express
A Drop Strikes Differently
A raindrop falling to the ground strikes with a certain force. But what if the drop isn't round but elongated like a cigar or flattened like a pancake? It turns out that shape is everything: the impact force can vary by more than a factor of ten just because of how the drop looks at the moment of impact.
Chaotic Dynamics2026-03-142 minarXiv:2603.13789express
Why Some Vortices Are Predictable and Others Aren't
In a turbulent flow, like a raging river, energy constantly cascades from large whirlpools to small ones. Occasionally, particularly powerful bursts occur, resembling sudden waves crashing against the shore. Scientists asked: can we know in advance when such a "wave" will strike? It turns out the answer depends on which vortices are present in the flow at that moment.
Stellar2026-03-051 minarXiv:2603.06712express
Solar Flares: Forecasting with Confidence
Solar flares — sudden energy releases on the Sun — can knock out satellites and power grids. Previous models often either cried wolf or missed a real blow. The fix: attach a reliability estimate to every prediction.
Machine Learning2026-02-261 minarXiv:2602.23146express
Weather in Every Backyard
The weather on the next street can differ from yours: cooler by the river, hotter over asphalt, windier between buildings. A regular forecast misses this: its grid cell is the size of a city, not a backyard.
physics.data-an2026-02-211 minarXiv:2602.18949express
A Forecast That Remembers the Cycle
A solar panel on a roof produces little current in the morning, a lot at noon, and stays silent at night. Wind doesn't blow randomly either: it's often stronger in the morning and evening than during the day. Energy providers need to know in advance how much energy will be available in an hour or three, so they can switch on backup plants or store electricity in batteries in time.
El Niño 2026: Two Barometers, One Forecast
Two barometers hang on the wall. One reads clear, the other says partly cloudy. Which weather do you trust? That is roughly the question facing a group of climate scientists when two independent methods predicted different futures for the Pacific Ocean in 2026.
q-bio.PE2026-02-082 minarXiv:2602.08101express
A Virus Hits Like a Punch: Why Outbreaks Don't Follow the Average
An epidemic is not a steady stream but a series of hits. One carrier may infect no one, while another infects fifty people at once. Such rare but powerful events are called 'dragon kings': they stand out from the overall pattern and determine how severe a disease wave will be. In the new study, the virus is compared to a billiard ball.
q-bio.PE2026-01-262 minarXiv:2601.18703express
How an Epidemic Flows Through a City
An epidemic is like a forest fire: the flames race toward where there are more dry branches. Similarly, a virus spreads faster where people live in closer quarters. But old mathematical models described infection as an ink blot spreading evenly across paper.
Quantum Physics2026-01-211 minarXiv:2601.15263express
Why Superluminal Signals Tangle Time
According to the laws of physics, nothing can outrun light, otherwise for some observers the effect would occur before the cause. Artur Ekert and Andrzej Dragan showed that this situation creates an uncertainty resembling quantum indeterminacy.
Rain Is Learning to Fall Less Often but Harder
Rain doesn't fall just any old way. If you take records from nearly fifty thousand rain gauges scattered across the globe and compare how much water falls on a rainy day in different parts of the planet, you'll spot a surprising pattern.
A Ceiling of Randomness
Each Atlantic hurricane season is like a game of dice, where the number of spots depends on three major climate forces: El Niño, ocean temperature in the 'hurricane nursery,' and the North Atlantic Oscillation.
A neural network trained on 127,137 years of model climate predicts winter
A translator who learned a language from thousands of books can interpret a conversation without being distracted by noise in the hall. Similarly, a neural network trained on 127,137 years of model climate produces a winter forecast in a fraction of a second, faster and more accurately than bulky dynamical systems.
stat.ME2020-10-053 minarXiv:2010.02247
A Causal Map Without Intervention
An orchestra without a conductor plays in harmony, and you want to understand who influences whom. The violinist hears the cello, the cellist catches the rhythm of the percussion, and the flute adapts to everyone at once.
stat.ME2019-04-052 minarXiv:1904.02855
How to Make Your Model Pay for Its Mistakes
A translator who jumps at every rustle in the hall starts mixing up words by the end of the meeting. Their confidence in being right grows, while their accuracy drops. That is roughly how poorly calibrated probabilistic forecasts behave: the model claims a high probability for an event, but reality disagrees.
How Measurement Gives Rise to Quantum Noise
In 1946, Felix Bloch predicted that even without an external magnetic field, a fluctuating magnetic moment exists in an ensemble of spins. It grows as the square root of the number of particles, and in small samples this noise can exceed thermal polarization.