Stochastic processes are collections of random variables representing the evolution of random systems over time.A random process defines a probabilistic rule according to which a system transitions from one state to another over time. Unlike deterministic laws (like an apple falling), we can only talk about the probabilities of various trajectories. For example, radioactive decay of atoms is a Poisson random process: decay times are unpredictable, but the average number of decays per minute is stable.
The formal theory of stochastic processes began to take shape in the early 20th century with the works of Louis Bachelier (1900) on Brownian motion and financial markets. Norbert Wiener in 1923 built a rigorous mathematical model of Brownian motion (Wiener process). Andrey Kolmogorov in 1931 laid the foundations of the axiomatic theory of random processes. The development of the theory was strongly motivated by problems in physics (diffusion), telecommunications (noise), and finance.
A stochastic process is described through transition probabilities between states. In discrete time, this can be a chain with given transition probabilities. In continuous time, the dynamics are given by stochastic differential equations (e.g., the Langevin equation for a Brownian particle). For analysis, the Chapman-Kolmogorov equation and the Fokker-Planck equation are often used. A key property — Markov property (the future depends only on the present) — leads to significant simplifications.
Predicting exchange rates, modeling traffic jams, and even generating realistic textures in computer games rely on random processes.
In 1905, Albert Einstein used a random process (Brownian motion) to prove the existence of atoms — he linked the chaotic movement of pollen to thermal jolts from molecules.
| S_t | variable | CUSUM statistic at time t |
| S_{t-1} | variable | CUSUM statistic at previous time |
| z_t | variable | Observation or standardized value at time t |
| k | variable | Allowance or reference value (positive constant) |
| max | operator | Takes the maximum of two numbers — maximum |
| x_t | variable | value of the process at time t — time series value |
| x_{t-1} | variable | value of the process at previous time — time series value |
| \phi | variable | autoregressive coefficient — autoregressive coefficient |
| \epsilon_t | variable | white noise innovation at time t — noise term |
| \sigma^2 | variable | variance of the noise — variance |












