transfer learning

A jazz trio plays in the dim light of a club. The pianist leads the melody, the bassist holds the rhythm, and the drummer sprinkles out rolls. If you listen only to pairs of musicians, you can catch how the pianist adjusts to the bass or the bass to the drums.

In the Antarctic ice, a ghost particle leaves behind only a faint flash of blue light. The IceCube detector captures these flashes, and from them we need to infer where the particle came from. The PolarBERT model has learned to do this, but what exactly it sees inside has remained a mystery.

A fusion reactor is like a super-hot furnace where plasma reaches millions of degrees. The walls are made of tungsten, the most refractory metal there is. But even tungsten needs protection: fast particles from the plasma bombard the surface and knock atoms loose. These ejected atoms enter the plasma and cool it down, like a spoonful of cold milk in hot tea.

The instrument shines an infrared beam at a sample, and molecules respond with their own absorption pattern, like bells of different tones. This pattern, the spectrum, holds information about the chemical composition. But to read it, a specialist usually consults a library of reference records, which is slow and not always possible.

A person flips a coin to make a decision. They stand still — the coin lands heads. They take a few steps, and flip again. It would seem walking shouldn't affect the coin. But what if the walk itself changes how often they decide to simply repeat the previous toss? That's exactly what researchers tested.

In the long extensions of a neuron, the dendrites, tiny couriers are constantly bustling about. These are messenger RNA molecules carrying instructions for protein assembly. Their journey starts at the cell body and ends at synapses — contacts with other neurons.

A basin of wet sand. You press in one corner, and water starts moving. But how exactly? Instead of an even circle, it might spread in tongues, linger in some spots, and rush through others. Underground, the same thing happens: oil, water, or gas migrate through rocks not by the textbook, but following the chaos of fractures and heterogeneities.

Imagine a cookbook that gets rewritten from generation to generation. One day, the borscht recipe receives a secret ingredient from a pastry chef, and from that moment, the taste remembers not only ancestors but also a neighbor. In the Standard Model of evolution, genes behave the same way.

Radio signals in a room act just like sound in a concert hall: bouncing off walls and objects, they create a unique pattern — a silent melody for every location. Your phone, like a keen ear, catches this melody amid noise and distortion. It remembers which chord matches the corner of the couch, and which one fits the doorway.

The robot juggler catches and throws balls in precise rhythm with a human, like two пульсара sending pulses in unison. Juggling three balls is a classic cascade, governed by a steady beat, like the uniform rotation of a cosmic lighthouse. Break the rhythm and the pattern crumbles.

When an unmanned aerial vehicle learns from an experienced pilot, it memorizes not individual maneuvers but entire safe corridors — the trajectories along which the human mentor moved. This approach is called imitation learning: the machine mimics expert demonstrations.

In calm water, the route is clear. But in turbulent flows, a robot needs a different strategy. Typical approaches demand an accurate map of currents, but in reality, you can't get one. Nature does it differently: fish feel pressure and vortices right against their bodies.

In any city project, residents' behavior is a invisible force that determines success. One skeptical neighbor can slow down solar panel installation across an entire block: their caution triggers a rise in disorder.

In a kitchen with gas burners, each heats differently. If the cook moves the pots, food may burn. Just so in a wireless network: the antenna-burners and user-pots require precise placement. Ordinary neural networks don’t distinguish positions, treating all burners as identical. So they struggle to estimate signal quality or adjust transmission.

When you type 'salad' and the keyboard suggests 'Caesar,' behind the scenes millions of phones are jointly learning to predict words. They share not your messages, but only improvements to the common algorithm, like a coach who sends athletes only the tweaks to the plan: 'add 5 push-ups to yesterday’s routine.' Information entropy helps send only unexpected, valuable updates.

DFTB is a high-speed train in the world of quantum chemistry: hundreds of times faster than classical DFT, yet still on electronic rails. But its engine — iterative self-consistency of charges — sometimes resembles an orchestra where each instrument starts from an arbitrary note.

A runner loses on both a smooth track and sticky sand. Seems hopeless. But if the surface underfoot starts changing every few seconds (track, then sand) the runner suddenly stops falling behind. He doesn't get faster; the environment just doesn't get a chance to 'crush' his weakness. That's exactly what the authors found when studying a simple predator–prey model.

Inside a fusion reactor, plasma rages — a gas heated to millions of degrees. There are no direct windows, and cameras and sensors quickly fail. Engineers see only fragments of information: a few sensors at scattered points. It's like trying to grasp a symphony from the sound of three microphones in a vast hall.

60 mice, 1,980 samples, 234 lung cancer patients. Behind each number lie thousands of genes. Their activity is measured to understand the disease. But the data aren’t uniform: for one patient, you assess a protein level (a continuous number), make a diagnosis (yes/no), and determine the tumor subtype (a category).

Quantum spin chains resemble a line of people passing along a secret handshake: each turns to a neighbor, and how firmly they clasp palms determines how the wave runs through the entire chain. In the ideal Heisenberg chain, quantum magnetism’s bedrock, all handshakes are equal.

The brain doesn't learn every task from scratch: it transfers experience from one activity to another. But how do you know which tasks are truly related? Neuroscientists came up with a clever trick: let an artificial network "peek" at brain activity during one task and try to predict activity during another. If it works well, the tasks are close.

A city is a living system: it consumes resources, produces waste, and its 'circulatory system'—the road network — delivers people and goods to their destinations. But while engineers design transport arteries as rigid geometry of straight lines, nature has spent millions of years perfecting ideal distribution networks.

Two ultra-dense stars spiral around each other and eventually collide. This dance lasts only moments, but it sends powerful ripples through space — gravitational waves. After the merger, a rapidly spinning blob remains, ringing like a bell, and that ring carries information about what the stars were made of.

The MethaneSAT satellite scans for leaks of метана — a gas that's invisible but packs a powerful planetary warming punch. Its "nose" is a спектрометр, a device that spots the subtlest color changes in light passing through the atmosphere — the telltale sign of methane.

At a party, guests don't just chat in pairs; they gather in circles of shared interests: three discussing movies, four debating sports. The usual acquaintance map, like a phone's contact list, can't capture that: it only sees one-on-one links.

Every carbon atom in a molecule carries a passport — the energy with which its deepest electrons sit in their orbitals. This energy is sensitive to neighbors: add an oxygen nearby or a double bond, and the number in the passport changes. Chemists have long measured such energies with X-rays, but calculating each new molecule takes hours of machine time.

A doctor holds a stack of test results taken at different times. Each sheet on its own is just a snapshot of a single day, but what you want is a whole movie of how the disease unfolded. A neural network called Tempo learns to glue these scattered frames into a smooth reel.

Training an accurate aerodynamic model is like culinary art: first, a chef masters hundreds of recipes to grasp the general principles, then easily perfects a specific dish. Engineers created AeroTransformer and fed it 30,000 different wing shapes — a whole galaxy of culinary ideas galaxy.

A city map: intersections are nodes, streets are connections. For an algorithm to understand the structure, each node needs a label. The classical approach — standard model — assigns simple tags, like house numbers.

A neural network trained on collisions of protons and electrons transferred its skills to a completely different experiment — catching neutrinos. Like a chef who learned French cuisine and then, without preparation, baked an excellent Uzbek plov.

Prostate cancer radiation therapy requires precise calculation of the radiation dose at every point in the body. The classic Monte Carlo method simulates millions of particles and takes hours, while adapting the plan to daily anatomical changes needs seconds.

A translator who has never been in a meeting translates literally, and loses half the meaning. They don't know that the boss's nod means "do it like last time," and the phrase "well, we'll see" is a polite refusal. That's how a language model that writes code from a scientific paper works: it can read the equations, but not the unspoken agreements.

Seismologists listen to the Earth the way a doctor listens to a heart. Surface waves from earthquakes travel across the planet, and their speed reveals what lies beneath our feet — solid rock, melt, or water. Usually, this requires building complex physical models.

Heat flows through matter like water through pipes: sometimes fast, sometimes barely. Engineers seek materials that almost don't let heat pass — like clogged pipes. Such insulators are vital for energy saving and devices that turn heat into electricity. The neural network KappaFormer quickly evaluates the "throughput" of an atomic structure.

When you stir sugar into a glass, the water seems to move every which way. But inside a chemical reactor with an impeller, the liquid isn't just churning: it forms hidden "islands" that barely exchange their contents. Scientists found a way to see these islands by following the paths of tiny particles.

In a regular battery, the electrolyte is liquid, and charged particles (ions) move freely. In the solid-state version, they squeeze through atomic 'corridors', like pedestrians in narrow passages. For a battery to work quickly, you need a material with high ionic conductivity.

Proteins in nature are as numerous as grains of sand on a beach, and each has its own job: some break down food, others build cells. But to understand what a specific protein does, it must be studied in the lab — a slow and expensive process.

Turbulent water flowing through a pipe and the swing of a pendulum may seem worlds apart. But they share something fundamental: both follow their own laws of motion, which can be described by numbers. A neural network trained on just one such 'dance of numbers' suddenly starts to understand another — without a single extra example.

Just as Water changes phase, freezing into ice or evaporating into vapor, forsterite, a key mineral of Earth's mantle, under pressures of hundreds of thousands of atmospheres, reassembles its crystal lattice.

A quantum system, like a person in a noisy room, gradually loses the thread of conversation: its state dissipates into the surroundings. But sometimes, as if suddenly recalling an important thought, it can recover part of the lost information. Physicists call this phenomenon non-Markovian dynamics: the environment's memory of the system's past allows information to flow back.