A model with parameters of parameters — the way to fit a population and its individual members at once.A Bayesian hierarchical model is a statistical model that has multiple levels of parameters, where parameters at one level are themselves modeled by parameters at a higher level. This structure allows you to simultaneously model individual observations and the population from which they come. For example, you might model the test scores of students in many schools, where each school has its own average score, but those school averages are drawn from a common distribution representing all schools. This 'borrowing strength' across groups improves estimates, especially for groups with few data points.
Hierarchical models have roots in the work of Charles Stein in the 1950s on shrinkage estimators, and were formalized in Bayesian terms by Lindley and Smith in 1972. They became widely used with the advent of MCMC in the 1990s.
The model is built in layers. At the lowest level, you have the likelihood for each observation given individual-level parameters. At the next level, those individual parameters are assumed to come from a common distribution with hyperparameters. The hyperparameters themselves may have priors. Inference is done by computing the joint posterior over all parameters, often using Markov Chain Monte Carlo (MCMC) methods. The hierarchical structure allows the data to inform both the individual estimates and the population-level distribution, leading to shrinkage of extreme estimates toward the group mean.
They are used in meta-analysis, education research, clinical trials with multiple centers, and ecology for modeling species distributions across sites.
Hierarchical models are the statistical foundation behind 'Bayesian shrinkage', which can improve predictions by pulling extreme estimates toward the overall average — a phenomenon known as Stein's paradox.


















