process

training

The process of adjusting a model's parameters to minimize error on a dataset.
91 related articles

Description

Training is the core process in machine learning where a model's internal parameters are iteratively adjusted to minimize the difference between its predictions and the actual outcomes in a dataset. This is achieved by feeding the model examples, comparing its output to the known correct answer, and updating the parameters to reduce the error. The goal is for the model to learn patterns from the data so it can make accurate predictions on new, unseen data.

History

The concept of training neural networks by adjusting weights dates back to the 1950s with Frank Rosenblatt's perceptron, but the modern backpropagation algorithm, which made training multi-layer networks practical, was popularized in the 1980s by David Rumelhart, Geoffrey Hinton, and Ronald Williams.

How it works

Training typically involves an optimization algorithm, such as gradient descent. The model makes a prediction, a loss function quantifies how wrong it is, and the algorithm calculates the gradient of that loss with respect to each parameter. The parameters are then adjusted in the direction that reduces the loss, and this process is repeated over many iterations (epochs) until the loss converges to a minimum. The choice of architecture, data quality, and hyperparameters like learning rate all influence how effectively the model learns.

In practice

Training is used everywhere in modern technology: from training neural networks to predict material properties in computational chemistry, to teaching AI models to interpret medical images, to fine-tuning large language models that generate human-like text.

Fun fact

Some neural network models are so complex that training them can consume as much electricity as a small town, and the process often requires specialized hardware like GPUs or TPUs to complete in a reasonable time.

Concept graph →

Related articles · 91

Chemical Physics2026-08-211 minarXiv:2608.21322express
Counting Protein Jitters in Seconds
A protein in a cell doesn't hang motionless like a mannequin in a store window. Its atoms are constantly jiggling, stretching, and bending, like a plucked guitar string that keeps vibrating after you strum it. To understand how a protein works, you need to know how tightly each part holds onto its neighbors.
A Diamond Compass That Learns on Its Own: Physics Inside a Neural Network
Diamond is not just a gemstone. Hidden inside its crystal lattice are defects that sense magnetic fields better than many instruments. One such defect, the NV center, acts as a tiny compass, but its needle wavers from heat and noise. For the compass to point accurately, calibration is needed.
q-bio.BM2026-08-191 minarXiv:2608.18604express
How Protein Engineers Learn from Mistakes
A protein engineer is like a chef trying to make a dish that is tasty, healthy, and cheap all at once. Change one ingredient, and you risk ruining another. In the past, computer assistants could only evaluate protein properties one at a time, missing how they are connected.
Monroe: A Molecular Model with In-Context Probabilistic Inference
An interpreter gets distracted by every rustle in the hall, and a one-hour meeting stretches into two. Similarly, molecular foundation models learn the language of molecules from vast corpora, but each new conversation requires fine-tuning. Monroe changes the rules: it doesn't learn a new language but instantly finds common meaning from a few examples.
Materials2026-08-131 minarXiv:2608.13038express
Boron Film for the Fusion Furnace
A fusion reactor is like a super-hot furnace where plasma reaches millions of degrees. The walls are made of tungsten, the most refractory metal there is. But even tungsten needs protection: fast particles from the plasma bombard the surface and knock atoms loose. These ejected atoms enter the plasma and cool it down, like a spoonful of cold milk in hot tea.
Why Perovskite Solar Cells Age
A perovskite solar cell is like a young athlete: it performs brilliantly at first, but tires with age. Over eight hours, its performance drops noticeably, with no visible cause like cracks or dust. Scientists took one cell and recorded its performance at 0, 90, 280, and 480 minutes of its life.
Movement Alters Decisions
A person flips a coin to make a decision. They stand still — the coin lands heads. They take a few steps, and flip again. It would seem walking shouldn't affect the coin. But what if the walk itself changes how often they decide to simply repeat the previous toss? That's exactly what researchers tested.
A Bias That Needs No Teacher
In a warehouse, there are boxes of apples and pears. There are many apples and few pears. But when the stock clerk says "a fruit with smooth skin," we are somehow more likely to recall the rare pear than the common apple. This is the inverse base-rate effect — a persistent glitch in how the brain resolves ambiguity between categories.
Statistical ML2026-08-012 minarXiv:2608.00675express
Round Trip: How a Neural Network Checks Itself Without Hints
A neural network predicts the future of a system — say, how plasma will swirl in a magnetic field or how a face in a video will change. Errors are inevitable, and the further it looks ahead, the more they accumulate. Checking against the correct answer during operation is impossible: it simply doesn't exist.
Statistical Mech2026-07-212 minarXiv:2607.18905express
Protein Courier: Why Speed Isn't Everything
Inside every cell, logistics is in full swing: tiny protein motors, like couriers, haul cargo along a network of microtubules. One of the main workhorses is kinesin, which steps using the energy of ATP (the cell's main energy currency). For a long time, researchers tried to evaluate it like a car: how much fuel it burns, how fast it gets there.
Galaxies2026-07-183 minarXiv:2607.16763
Stellar Pinball: An Algorithm That Reads the Rules of Chaos
A hundred thousand stars in the dense core of a globular cluster move like steel balls in a giant pinball machine. Each 'bump' — a gravitational encounter between a binary system and a single star — triggers a cascade of unpredictable events.
eess.SY2026-07-161 minarXiv:2607.14606express
How to read an enemy in the sky in seconds
In combat, a pilot needs to instantly understand what an object is and what its intentions are. Conventional systems wait for complete radar data — like a goalkeeper who only reacts after the shot. The new algorithm works like an experienced goalkeeper: from the attacker's first moves, it predicts the target's maneuver.
Image Processing2026-07-161 minarXiv:2607.14894express
Why photo enhancement software fails on unfamiliar images
The photo enhancement algorithm is like a navigator that step by step leads a blurry picture toward a sharp view. It removes noise and distortions, moving pixel by pixel along a familiar map. But if the image was taken in unfamiliar conditions (say, with unusual blur) the map doesn't match the terrain.
Signal Processing2026-07-161 minarXiv:2607.14938express
Where Are You? Radio Waves Know the Answer
Radio signals in a room act just like sound in a concert hall: bouncing off walls and objects, they create a unique pattern — a silent melody for every location. Your phone, like a keen ear, catches this melody amid noise and distortion. It remembers which chord matches the corner of the couch, and which one fits the doorway.
Machine Learning2026-07-161 minarXiv:2607.14995express
How to Teach AI Not to Confuse Similar MRI Scans
Ordinary AI looks at medical images like puzzles made of unfamiliar pieces: it considers any two unmatched pictures completely different. It's like trying to tell twins apart without knowing they're related. In medicine, however, patients with the same condition look nearly identical on MRI, and the algorithm mistakes 'relatives'.
Robotics2026-07-161 minarXiv:2607.15129express
Robot Juggler: Synchronized Play with a Human
The robot juggler catches and throws balls in precise rhythm with a human, like two пульсара sending pulses in unison. Juggling three balls is a classic cascade, governed by a steady beat, like the uniform rotation of a cosmic lighthouse. Break the rhythm and the pattern crumbles.
eess.AS2026-07-161 minarXiv:2607.15243express
The Illusion of Accuracy: How AI Testing in Acoustics Misleads
An AI predicting room acoustics is like a student taking an exam with a cheat sheet. If the test points are the same as the training ones, the model simply memorizes the acoustic 'fingerprint' of each position — like a student recognizing a question by the dog-eared corner.
eess.SY2026-07-151 minarXiv:2607.13513express
Smart Shower: Taming an Unpredictable System
You're standing in the shower: you turn the tap, and the water is either freezing or scalding. The pipes have a mind of their own — the pressure jumps unpredictably. The new controller learns on the go: it doesn't know the plumbing layout, but within minutes it adapts and gently guides the temperature to comfort, without breaching safety limits.
Image Processing2026-07-151 minarXiv:2607.13601express
Video Instead of Dozens of Shots: Urine Analysis Made Easier
A drop of urine under a microscope isn't a flat puddle but a multi-layered volume. Like a stack of transparent pages: if you focus on one, the neighboring ones blur. The microscope's light only shows one depth layer sharply. To see all the cells, a lab technician had to take a series of snapshots, manually adjusting focus — tedious and slow.
Machine Learning2026-07-151 minarXiv:2607.14086express
Brain Signals: Learning to Understand Without a Teacher
The brain communicates in short electrical clicks. Previously, to learn this language, thousands of examples with translations from the experimenter were needed. MOJO takes a different path: like learning a language through immersion, it first listens to the 'stream of consciousness' without any hints and finds recurring patterns on its own.
eess.SY2026-07-151 minarXiv:2607.14273express
How to Track Heat Across an Entire Room with Just One Thermometer
In a soup pot, you only need two thermometers to gauge the temperature everywhere — if you know heat travels in circles from the bottom. Science works the same way: from a handful of measurements, you want to reconstruct the full heat picture. The system captures the gist of heat flow, compressing it into a handful of governing numbers.
eess.SY2026-07-141 minarXiv:2607.12343express
How a Smart Algorithm Learns Not to Crash
A driver on a slippery road doesn't know exactly how the car will respond to the steering wheel, and learns on the go, leaving room for error. A smart control algorithm behaves in a similar way.
eess.SY2026-07-142 minarXiv:2607.12590express
Coevolution of Agent and Environment: How an Algorithm Learns to Reshape the World Around It
Traditionally, machine learning algorithms operate in a static environment, like water flowing along a pre-cut channel without changing its shape. The new method flips this paradigm: it lets an agent simultaneously master actions and deliberately modify the very environment it inhabits.
Machine Learning2026-07-141 minarXiv:2607.12771express
AI Masters the Cookbook of Chemical Reactions
Cooking a complex dish requires a clear recipe: first chop, then sauté, add spices at just the right moment. Chemical transformations also follow step-by-step recipes — mechanisms where atoms of carbon and hydrogen rearrange in a strict order. Previously, neural networks often invented nonexistent steps, like a whimsical cook swapping salt for sugar.
Information Theory2026-07-141 minarXiv:2607.13119express
Dual Hints: How Smartphones Learn Without Glitches
When you type 'salad' and the keyboard suggests 'Caesar,' behind the scenes millions of phones are jointly learning to predict words. They share not your messages, but only improvements to the common algorithm, like a coach who sends athletes only the tweaks to the plan: 'add 5 push-ups to yesterday’s routine.' Information entropy helps send only unexpected, valuable updates.
Actions are recognized by posture, not by trajectory
Researchers took 16 everyday activities — from washing dishes to squatting — and broke the movements down into elementary components, much like a spectroscope splits light into a spectrum. Comparing three approaches, they found an unexpected key to recognition: a single averaged snapshot is enough. Only nine joints out of dozens carried the crucial information — the rest hardly mattered.
Machine Learning2026-07-131 minarXiv:2607.11091express
Neighbor molecules improve prediction accuracy
Predicting the properties of a new molecule is like guessing the flavor of an unfamiliar dish. The program works like an experienced chef: it “tastes” similar molecules whose properties are already known, and based on their “flavor,” it refines its guess.
eess.SY2026-07-131 minarXiv:2607.11122express
Float Controller: Stability via an Instant Equation
The float in a toilet tank is an ideal controller: sensing the water level, it instantly brings the system into equilibrium without looking back at the past. Engineers applied this principle to neural networks.
math.OC2026-07-131 minarXiv:2607.11344express
Taming Chaos: How Algorithms Predict the Future
Complex machinery, from drones to surgical robots, sometimes behaves like a wild mustang: full of disorder and whims, where the slightest touch triggers a storm. Instead of rote memorization of formulas, the new method observes the system like a horse breaker.
Topology by Aroma: How One Spin Gives Away the Quantum Phase
For a long time, identifying quantum phases was like interrogating a witness: you had to reach every corner of the system to uncover its secret. In the era of Landau, order was tied to symmetry breaking and a local parameter — everything plain as day.
Materials2026-07-103 minarXiv:2607.09304
Warm Start for a Quantum Engine: How Machine Learning Accelerates Molecular Calculations
DFTB is a high-speed train in the world of quantum chemistry: hundreds of times faster than classical DFT, yet still on electronic rails. But its engine — iterative self-consistency of charges — sometimes resembles an orchestra where each instrument starts from an arbitrary note.
q-bio.QM2026-07-092 minarXiv:2607.08902express
A Hormonal Assistant with a Flair for Math
Inside each of us, invisible clocks are ticking. They control the release of cortisol — the hormone that helps us wake up in the morning, cope with anxiety, and keep our immune system on its toes. In adrenal insufficiency, these clocks break down: the body can't produce the right amount of cortisol on its own.
Echo in the Labyrinth: Why Machine Learning Only Hears Echoes
Gravitational signals from dying massive stars are whispers reaching us from the most violent laboratories in the Universe. Einstein predicted these gravitational waves over a century ago, but only today, with detectors like LIGO, are we beginning to hear them.
Digital Polisher: How a Neural Network Unveils the Secrets of Binary Gravitational Lenses
Gravitational microlensing is a fascinating cosmic effect predicted by Einstein and developed by Zwicky. A massive body passing between us and a distant star bends its light like a lens, creating characteristic magnifications and distortions.
Materials2026-07-063 minarXiv:2607.05321
How a Polyglot Neural Network Uncovered an Atomic Secret: Why Protective Coatings Destroy Solar Cells
Hybrid perovskites are the rising stars of photovoltaics: their efficiency is growing so fast it feels like we're on the brink of a solar revolution. But these materials, like intricate atomic mosaics, are extremely vulnerable — moisture, heat, and light quickly turn them to dust.
q-bio.PE2026-07-052 minarXiv:2607.04456express
How Life Learns to Survive
Molecules float in a pot of broth. Some copy themselves, others help their neighbors, and still others just get in the way. This isn't soup: it's a model of early life: a replicator system. Usually, we assume the rules of the game are fixed once and for all: whoever reproduces fastest wins. But the authors of this study proposed something different — the rules can change too, just very slowly.
cs.PF2026-07-033 minarXiv:2607.02945
Straightening Graph Paths: How Meta Sped Up Neural Network Training by 63%
Recommendation systems that decide which post you’ll see next run on deep neural networks made up of thousands of operations — intricate computation Graphs (blueprints of operations on data). These systems are living, ever-evolving Dynamical Systems: the slightest architecture change cascades through the entire graph.
Materials2026-07-022 minarXiv:2607.01713
Symphony of Crystals: A Three-Round Audition for Future Materials
Imagine an audition for a symphony orchestra, where out of hundreds of hopefuls, only those whose instruments sound pure and withstand the furious crescendo remain. In the world of materials, computers have learned to generate 'atomic scores'—thousands of virtual crystals that promise to become the foundation for quantum chips or superconductors.
Genes Speak Different Languages — A Neural Network Found a Common One
60 mice, 1,980 samples, 234 lung cancer patients. Behind each number lie thousands of genes. Their activity is measured to understand the disease. But the data aren’t uniform: for one patient, you assess a protein level (a continuous number), make a diagnosis (yes/no), and determine the tumor subtype (a category).