statistics

boosted decision tree

A committee of simple trees, each fixing the errors of the last; long the standard classifier in particle physics.
29 related articles

Description

Boosted decision trees (BDTs) are an ensemble learning method that combines many simple decision trees to produce a powerful classifier. Each tree is trained sequentially, with each new tree focusing on the mistakes made by the previous ones. BDTs have been the workhorse classifier in high-energy particle physics for over a decade, used to distinguish rare signal events from overwhelming background noise in collider data.

History

The concept of boosting was introduced by Robert Schapire in 1990, and the AdaBoost algorithm was developed by Freund and Schapire in 1995. BDTs became standard in particle physics after the discovery of the Higgs boson in 2012, where they played a key role in separating the Higgs signal from background.

How it works

The most common boosting algorithm is AdaBoost: start with a set of weights on training samples, train a shallow tree, then increase the weights of misclassified samples and decrease the weights of correctly classified ones. The next tree is trained on the reweighted data, and the process repeats. The final prediction is a weighted vote of all trees. Gradient boosting is a generalization that optimizes an arbitrary loss function by fitting each new tree to the residual errors of the current ensemble.

In practice

BDTs are used in particle physics for event classification, in credit scoring for risk assessment, and in medical diagnostics for disease prediction from patient data.

Fun fact

In the 2012 Higgs boson discovery, BDTs were so effective that they helped extract a signal that appeared in only about one in a trillion proton-proton collisions.

Concept graph →

Related articles · 29

Quantum Physics2026-08-102 minarXiv:2608.09583express
The Noise That Helps Fix Errors
A quantum computer is like an orchestra where each musician, a qubit, plays their part but keeps hitting wrong notes. To keep the music from turning into cacophony, you need a conductor who instantly hears the off-key notes and corrects them.
Division That Doesn't Fragment Memory
Holding in mind the exact position of a pen as it's slowly moved is a routine task for the brain. For artificial neural networks, it's nearly impossible. Standard recurrent networks like GRU and LSTM tend to break continuous motion into rigid steps: the pen doesn't glide smoothly but jumps from point to point.
Machine Learning2026-07-151 minarXiv:2607.13891express
Radar Without Learning: How PiVoT Turns Noise into Order
A regular radar is like a microphone in a buzzing crowd: individual sounds blend into mush. PiVoT works like a conductor who instantly recognizes each instrument in the tuning chaos. Instead of shuffling through hypotheses, the algorithm tightens a loop around the most likely targets — cars, cyclists, pedestrians.
eess.AS2026-07-141 minarXiv:2607.12529express
Hearing Aids Learn to Taste Sound
Traditional hearing aids resemble a chef who cooks from a recipe blindly. They analyze the sound chaos from the microphone and amplify speech based on it. In a noisy café, this approach often errs. The new system behaves like an experienced cook: first processes the signal, then samples the result.
math.OC2026-07-141 minarXiv:2607.12775express
Smart Acceleration: Teaching the Power Grid to Think Faster
Power systems with solar panels and wind turbines are like a chess game: cloud cover and load changes are the opponent's moves, impossible to foresee. To maintain balance, operators used to run through dozens of scenarios (uncertainty) — that took too much time and computing power.
Information Theory2026-07-141 minarXiv:2607.13119express
Dual Hints: How Smartphones Learn Without Glitches
When you type 'salad' and the keyboard suggests 'Caesar,' behind the scenes millions of phones are jointly learning to predict words. They share not your messages, but only improvements to the common algorithm, like a coach who sends athletes only the tweaks to the plan: 'add 5 push-ups to yesterday’s routine.' Information entropy helps send only unexpected, valuable updates.
Information Theory2026-07-141 minarXiv:2607.13160express
Smart Mirrors for Signals: Balancing Energy and Speed
Radio waves from a smartphone, traveling at the speed of light, easily reflect off walls and corners, losing strength. Smart surfaces are programmable mirrors: they catch the scattered signal and redirect it precisely to its target, like a deft magician making a beam bypass obstacles.
Materials2026-07-103 minarXiv:2607.09304
Warm Start for a Quantum Engine: How Machine Learning Accelerates Molecular Calculations
DFTB is a high-speed train in the world of quantum chemistry: hundreds of times faster than classical DFT, yet still on electronic rails. But its engine — iterative self-consistency of charges — sometimes resembles an orchestra where each instrument starts from an arbitrary note.
Gravitational Tango: How a Neural Network with Physical Intuition Heard the Rhythm of Black Holes
Isolating the signal from a single pair of supermassive black holes is like hearing a dancer's footsteps amid the roar of a hurricane. Somewhere in space, these monsters spin in a slow gravitational tango, distorting spacetime itself.
Genes Speak Different Languages — A Neural Network Found a Common One
60 mice, 1,980 samples, 234 lung cancer patients. Behind each number lie thousands of genes. Their activity is measured to understand the disease. But the data aren’t uniform: for one patient, you assess a protein level (a continuous number), make a diagnosis (yes/no), and determine the tumor subtype (a category).
Molecular Ballet Without a Choreographer
A dance of hundreds of particles: some pairs spin slowly and gracefully, others twitch in a frantic rhythm. To understand the essence of the dance, you need to watch the slow movements: they are the main choreography of the system. In molecular science, such slow movements are called 'slow modes,' and they determine how a protein folds into a ball or how a drug binds to its target.
q-bio.QM2026-06-112 minarXiv:2606.13475express
How a Neural Network Eavesdropped on the Noise of Life
Population growth from a distance looks like a train picking up speed: it crawls at first, then gains momentum. But look closely at the data, and the picture blurs. One measurement shows a dozen individuals, another a hundred. Classical models wipe away this scatter like annoying smudges on a lens. They assume the noise is uniform and simply ignore it.
Neutrino Detector Learns to Hear Whispers
A photographer shoots a night forest, trying to catch fireflies in the frame. The flashes are rare and faint, while around there's the noise of wind and distant lights.
Cosmology2026-05-072 minarXiv:2605.05679express
Cosmic Orchestra Tests Dark Matter
Two heavy balls orbit on the surface of a pond. Ripples spread from them: these are gravitational waves. As the balls spiral closer, the waves carry away energy, and the ripples become more frequent.
Medical Physics2026-04-282 minarXiv:2604.25356express
X-ray detective without cheat sheets
You taste a fruit smoothie through two different straws. One lets through only the big chunks, the other only the liquid. Individually, the sensations are misleading, but together they give you the key: here, it seems, is banana, and here, strawberry.
Nuclear Theory2026-04-182 minarXiv:2604.16996express
How a neural network finds errors in physics textbooks
A uranium nucleus is like a tight wallet snapped shut on two halves. To make it burst and release energy (that is, to make the nucleus split) you have to climb over an energy barrier. The height of this threshold determines whether a substance is stable or ready to fall apart at any moment.
HEP Experiment2026-04-142 minarXiv:2604.13320express
Catcher of Smudged Electrons
When two particles fly at almost the same speed in the same direction, their signals in the detector merge, like two voices in unison. Telling a duet from a soloist is an art in itself.
HEP Experiment2026-04-102 minarXiv:2604.09809express
Neural Network Learns to Spot Higgs Boson Decays
At the Large Hadron Collider, protons collide, and from the flash dozens of particles are born. Among them may be traces of rare processes — for example, the decay of a Standard Model Higgs boson into two W bosons. But these particles fly apart so quickly that their tracks merge into a single wide jet.
Separating Signal from Noise in Particle Detectors
Particle detectors such as resistive plate chambers (RPCs) work like sensitive traps: when a charged particle flies through, it generates an electrical signal. But sometimes the chamber fires a false hit, as if an invisible hand pressed a doorbell. These spurious signals muddy the picture and make it harder to pinpoint the particle's path.
Quantum Gases2026-03-262 minarXiv:2603.25775express
Neural Network Spots Knots in Quantum Fog
In a cold cloud of atoms chilled to near absolute zero, energies can behave like threads that weave into braids. These braids are not just a pretty image: their pattern is tied to topology, the branch of mathematics that studies properties preserved under continuous deformations.
HEP Experiment2026-03-182 minarXiv:2603.18172express
How a Neural Network Sharpens Focus in Particle Showers
In the Large Hadron Collider's detectors, millions of particles are born every second. Their energy flashes in the calorimeter look like raindrops on a window pane: individual drops are visible, but when there are many and they merge, it's hard to make out each one. Physicists need to know exactly how much energy each particle carried and where it landed.
HEP Experiment2026-03-021 minarXiv:2603.02369express
The Detector That Never Tires
A particle detector at the Large Hadron Collider runs for years without stopping. Its sensors produce mountains of data every second, and among it all, you need to spot a fault quickly, like overheating or a broken channel. In the past, simple rules did this, but they often made mistakes.
q-bio.QM2026-02-262 minarXiv:2602.23269express
Training Neural Networks on Less, but Smarter
Proteins in nature are as numerous as grains of sand on a beach, and each has its own job: some break down food, others build cells. But to understand what a specific protein does, it must be studied in the lab — a slow and expensive process.
Machine Learning2026-02-212 minarXiv:2602.18679express
How a Neural Network Predicts the Unseen
Turbulent water flowing through a pipe and the swing of a pendulum may seem worlds apart. But they share something fundamental: both follow their own laws of motion, which can be described by numbers. A neural network trained on just one such 'dance of numbers' suddenly starts to understand another — without a single extra example.
Computer Vision2026-01-242 minarXiv:2601.17504express
Brain Tumor on Scans: Where Certainty Ends
Brain tissue on a scan looks like a stormy sky: bright patches, dark hollows, blurred edges. The tumor hides among these patterns, and the doctor needs to outline its contour to plan surgery or radiation. One MRI mode highlights edema, another the tumor core, a third dead areas.
q-fin.PR2025-12-272 minarXiv:2512.22660
Climate in the Price of a Bond: How Machine Learning Predicts Catastrophe Bond Coupons
In 1992, Hurricane Andrew tore through Florida, leaving insurers with $$15.5 billion in losses. Many companies went bankrupt, and the market devised a way to shift disaster risk onto investors: catastrophe bonds. These securities pay generous coupons as long as a specified disaster does not occur, such as a hurricane of a certain strength or an earthquake in a particular region.
Trees Predict Chaos Without Tuning
An orchestra without a conductor: the musicians take their seats, tune their instruments, and begin to play in harmony because each one hears the common rhythm. That is how TreeDOX works, a method that predicts chaotic time series without requiring the user to choose parameters or fine-tune anything.
Mapping Bifurcation Landscapes: How Numerical Continuation Reveals Hidden Mechanisms in Delay Systems
A cartographer charting a route through a mountain range notes not only peaks and valleys but also passes where the trail sharply changes direction.
A Council of a Hundred Short Experts Predicts El Niño's Whims
The barometer in the port of Papeete on Tahiti and the one in Darwin, Australia, are separated by 7,400 kilometers. When one shows high pressure, the other often shows low, and this difference, called the Southern Oscillation, drives rainfall from India to Brazil. Predicting it even a month ahead is a problem with a century-long history.