computer vision

In the 1980s, the DARPA speech recognition challenge settled the debate between statistical methods and hand-written rules, setting a common standard for the entire field.

A radiologist looks at an abdominal scan and sees not just organs but their spatial relationships: which kidney is larger, where the tumor lies relative to a vessel. It's like reading a map, where it's not enough to know where a city usually stands; you also need to measure the distance between two points on the ground.

Getting lost in a hall of mirrors is easy: every wall reflects another, and you feel like you've been here before. The brain gets similarly confused when surrounded by many similar places. Neurons responsible for the spatial map can fire the same signal for two different corners of a room. This is called spatial ambiguity.

You're looking for fireflies in a dark forest. Instead of photographing the whole forest every second and then poring over the images, you carry a small device that spots the flashes on its own and cuts out only a circle around each one. The rest, the blackness, isn't saved. That's exactly how the new sensor for scientific cameras works.

Data zips through optical fibers at the speed of light, but the path isn't perfect: the signal gets muddled, like a voice echoing down a long hallway. The faster the speed and the longer the distance, the worse the distortion. Usually, electronics fix this, but they can't keep up with light.

A beam of light enters a glass cell filled with cesium vapor and changes the internal state of the atoms: this is how information is recorded. A moment later, another beam reads it out by how the atoms absorb light. It's not a hard drive, but rather a notebook that turns its own pages. Eight such "pages" are created by an acousto-optic deflector — a device that bends light with sound.

A smartphone camera captures light with tiny sensors, but by themselves, they can't distinguish colors. So color filters are placed in front of them: red, green, blue, like stained glass in a window. Each sensor sees only its own color, and then software assembles the full picture from these pieces.

A low-dose X-ray image looks like a view through a fogged-up window: outlines are there, but details drown in a hazy veil. Doctors need such images during radiation therapy — to aim the beam precisely at the tumor and spare healthy tissue. But saving on radiation comes at the cost of noise, streaks, and artifacts that obscure what matters.

Predicting the yield of a chemical reaction is a bit like trying to guess the harvest knowing only the soil composition. Traditionally, chemists have relied on long columns of numbers, quantum descriptors, that describe electron energies but say nothing about molecular shape.

Predicting the yield of a chemical reaction is a bit like trying to guess the harvest knowing only the soil composition. Traditionally, chemists have relied on long columns of numbers, quantum descriptors, that describe electron energies but say nothing about molecular shape.

In the spiral galaxy Fireworks Galaxy — 6410 stellar nurseries. That's how many regions where massive stars are being born right now were identified by an algorithm on old ultraviolet radiation images from the Edwin Hubble. These aren't just blobs in a picture — each has a clear boundary, like a country on a contour map.

Each morning, dozens of telescopes swing toward the Sun. Their cameras catch a narrow band of red light — the Hα line, discovered by Johann Balmer. The images reveal dark, whimsically curved threads. They look like stitches in a giant tapestry sewn through the blazing corona.

An eye prosthesis sends the brain not a photograph but a sparse pattern of bright dots — phosphenes. To make out a cup or keys in this flickering noise, a person has to move their head like a flashlight in the dark, piecing together the object's outline bit by bit. It's a slow process, like assembling a puzzle where most pieces have been thrown away.

Assembling the puzzle of the Universe, astronomers are used to every new detail fitting perfectly into the already completed picture. But sometimes there are pieces that seem cut from another jigsaw. Twenty thousand active galactic nuclei, and eleven percent of them the neural network confidently rejects as alien.

Every time a child with cerebral palsy is about to move their leg, a distinctive electrical blip appears in the brain — a slow voltage shift. Scientists call it a movement-related potential. A brain-computer interface (a system that reads intentions from brain signals) can pick up this blip and turn it into a command for a training device.

The cameras of a self-driving car capture light like telescopes aimed at a distant galaxy. Each frame is a fragmented observation; together they must form a map of the road ahead. The computer, like an astronomer, doesn't just stitch images together: it generates several possible bird's-eye views and compares them to real data.

Ordinary radar marks a drone as just a dot. A new method turns radio echoes into a volumetric sculpture: the signal outlines shape, tilt, and motion.

In a three-dimensional scene, each point is like a candy whose color changes depending on the viewing angle. To describe this play of shades, dozens of numbers are stored for each point — a special mathematical function invented by Joseph Fourier. Memory fills up instantly.

The meditating brain is an orchestra, and attention is the conductor. When you're focused on your breath, all instruments play in harmony. But suddenly, a thought-cello plays a false note: that's mind wandering. An experienced conductor doesn't panic: they instantly catch the dissonance and gently guide the orchestra back to the main melody — the breath.

Ordinary AI looks at medical images like puzzles made of unfamiliar pieces: it considers any two unmatched pictures completely different. It's like trying to tell twins apart without knowing they're related. In medicine, however, patients with the same condition look nearly identical on MRI, and the algorithm mistakes 'relatives'.

A single-pixel camera works like an artist creating a picture through a stencil with many holes. In each frame, only a portion of the light, modulated by a mask, a spatial light modulator, reaches the single sensor, and then the computer reconstructs the full image by assembling this mosaic with computational algorithms.

Many natural processes are described by differential equations, but scientists often have only fragmentary data — a sort of torn map. The new computational method works like a cartographer who reconstructs a complete map of the terrain from a few landmarks.

A typical tracking program resembles a navigator steering a ship by the stars. But as soon as the sky clouds over, coordinates drift, and entropy (a measure of uncertainty) builds up in the data. The new algorithm gets a ‘co‑pilot’ — a module that monitors how confident the main navigator is.

A conductor holds not a baton but a brush, and each stroke gives birth to color and form. New technology works the same way: it transforms a song's mood into a panoramic video that surrounds the listener. First, the algorithm decomposes the track into emotions, similar to how light is analyzed by spectrum.

Data on gene activity usually looks like a long string of numbers, like a rainbow stripe (spectrum) with no visible connections. In the scVision model, these numbers are turned into a meaningful picture — not a list of ingredients, but a photo of a finished dish.

The modern standard approach to AI training is like a child locked in a library: he remembers millions of books but doesn't know that fire burns and falling hurts.

Chatting with living neurons is like tuning an old radio: it's not enough to find the right frequency: you've got to aim the antenna too.

Trained on ordinary images, the DINOv3 model unexpectedly began to see faces as a spectrum: on its own, without hints, it isolates the eye, nose, and mouth regions. Like an invisible spectroscope, it breaks down a portrait into parts, just as a prism splits light into colors. Across 200 videos, feature labeling accuracy reached 83% (random guessing is 23%).

A person in a boat turns by shifting their body weight. An unmanned vessel uses the same trick: a sliding weight inside the hull does the steering. Its movement is controlled by a neural network, anticipating the chaos of waves and gusts of wind. The propeller pushes the boat forward, while the weight shifts balance — like moving from one foot to the other.

Tomographs don't produce ready-made pictures. They collect numerous 'shadows' — projections of innards from different angles or using various signals — and mathematically reconstruct a 3D picture from them.

A child exploring an unfamiliar apartment crawls from object to object and remembers what is visible from each corner. This is how the brain builds a mental map — an internal model of space. The gradCSCG algorithm works on the same principle: it receives a video stream from a camera and independently draws a map of the room, relying only on the changing images.

In a kitchen with gas burners, each heats differently. If the cook moves the pots, food may burn. Just so in a wireless network: the antenna-burners and user-pots require precise placement. Ordinary neural networks don’t distinguish positions, treating all burners as identical. So they struggle to estimate signal quality or adjust transmission.

A cook who learns to cook from hand-drawn pictures risks ruining every dish. The same trap awaits computer vision: models need thousands of labeled images, but collecting them manually is expensive and tedious. Synthetic frames solve the problem, but only if they look real.

Modern machine vision systems are gaining autonomy: engineers have managed to implement an image recognition algorithm directly on a miniature chip, freeing the camera from having to send data to a bulky computer.

The float in a toilet tank is an ideal controller: sensing the water level, it instantly brings the system into equilibrium without looking back at the past. Engineers applied this principle to neural networks.

Building a light chip is like a game where you have to guide a beam through a maze of tiny mirrors and beam splitters. Each element acts like a railroad switch: it either lets light pass straight through or directs it to an adjacent track. The goal is to produce a specific light pattern at the output while using as few 'switches' as possible. Usually, engineers spend years finding the shortest route for each task.

An electron microscope is a giant pipe organ: instead of pipes (electromagnetic lenses, instead of air) a stream of accelerated electrons. It once merely painted mute frescoes of the atomic world, condemning scientists to grueling decipherment.

Look into the night sky — before you is not a scattering of lights, but a multi-layered manuscript. Under the bright ink of stars and galaxies appears a faded, almost erased text.

Gravitational microlensing is a fascinating cosmic effect predicted by Einstein and developed by Zwicky. A massive body passing between us and a distant star bends its light like a lens, creating characteristic magnifications and distortions.

In the young Universe, about ten billion years ago, galaxies resembled endless fields after a thunderstorm: everywhere, giant — thousands of light-years across — clumps of star formation were boiling up, where young stars were born with unbridled energy. Today, these patches are an almost vanished species: in nearby galaxies, raucous hotbeds are rare.