Drawing from a distribution chosen to put samples where they matter, then reweighting.Importance sampling is a variance-reduction technique used in Monte Carlo simulations to make estimates more efficient. Instead of drawing samples from the original probability distribution, you draw from a different, carefully chosen distribution that concentrates samples in regions that contribute most to the quantity being estimated. Each sample is then weighted by the ratio of the original to the sampling distribution to correct for the bias. This is particularly valuable when the target distribution has rare but important events, such as high-energy tails in particle physics or extreme fluctuations in statistical mechanics.
The technique was introduced in the 1950s by Herman Kahn and Theodore E. Harris in the context of Monte Carlo methods for particle transport, though the general idea of weighting samples has older roots in survey sampling.
Suppose you want to estimate the expectation of a function f(x) under distribution p(x). You choose a proposal distribution q(x) that is easy to sample from and that is large where f(x)p(x) is large. You draw samples from q(x), compute f(x)p(x)/q(x) for each, and average. The weights ensure the estimate is unbiased. The key is to choose q(x) so that the variance of the weighted samples is minimized, ideally making the integrand nearly constant. In practice, q(x) is often chosen as a shifted or scaled version of p(x) or as a distribution that approximates the target importance region.
Widely used in particle physics for event generation, in finance for pricing options, and in Bayesian statistics for posterior inference.
In high-energy physics, importance sampling is used to simulate rare processes like Higgs boson production, where the event rate is minuscule compared to background processes.







