concept

synthetic images

Computer-generated images used to train algorithms, mimicking real-world scenarios without actual data.
26 related articles

Description

Synthetic images are computer-generated pictures that mimic real-world scenes, used to train machine learning algorithms when actual data is scarce, expensive, or privacy-sensitive. In physics and engineering, they allow researchers to develop and test image-analysis models without needing thousands of real photographs or measurements. The titles 'Цифровые двойники учат томограф' and 'Нейросеть отличила настоящие кристаллы от фантазий' illustrate how synthetic data helps train systems to interpret medical scans or identify crystal structures.

History

The concept emerged with the rise of computer graphics in the 1970s and 1980s, but its systematic use for training neural networks became prominent in the 2010s with the deep learning boom. No single inventor is credited; it evolved from the need for labeled data in computer vision.

How it works

The process involves creating a virtual scene with known ground truth—objects, lighting, and noise are all controlled by the programmer. A rendering engine produces images that simulate the real sensor's response, including imperfections like blur, noise, and distortion. The algorithm is then trained on this labeled dataset, learning to map images to desired outputs. The key is that the synthetic data must be realistic enough that the model generalizes to real-world inputs, which often requires careful calibration against actual measurements.

In practice

Synthetic images are used to train autonomous vehicle perception systems, medical imaging diagnostics, and industrial inspection algorithms, reducing the need for costly manual labeling.

Fun fact

Synthetic training data can be generated in infinite variety, allowing algorithms to encounter rare edge cases—like a pedestrian in a wheelchair at night—that would be nearly impossible to capture in real life.

Concept graph →

Related articles · 26

How to pick a crystal thickness in 50 simulations
A translator at the negotiating table doesn't listen to every word; they grasp the meaning of whole phrases. Electron microscopy poses a similar challenge: you need to figure out the crystal's thickness and its tilt in the beam, and all you have is a diffraction pattern, a mosaic of thousands of bright and dark spots.
Seeing Through Shipping Containers
A shipping container is a steel safe the size of a room, packed with goods. X-rays struggle to see through it: thick walls and dense cargo block the rays. Enter muons — particles born high in the sky that constantly rain down on Earth. They can pass through even lead, but they veer slightly off course when they encounter something heavy.
Statistical Mech2026-08-102 minarXiv:2608.09714express
How Charged Particles Choose Their Crystal
In a pot of water, microscopic spheres, colloidal particles, are floating. Each sphere is coated with long polymer chains that look like a brush and carries an electric charge. If you get the temperature and solution composition right, the spheres start arranging themselves into ordered patterns — crystals.
Medical Physics2026-08-091 minarXiv:2608.08919express
How a Low-Dose X-Ray Becomes a Sharp Image
A low-dose X-ray image looks like a view through a fogged-up window: outlines are there, but details drown in a hazy veil. Doctors need such images during radiation therapy — to aim the beam precisely at the tumor and spare healthy tissue. But saving on radiation comes at the cost of noise, streaks, and artifacts that obscure what matters.
Image Processing2026-07-161 minarXiv:2607.15073express
World in Flickers: How a Camera Assembles an Image from Flashes
Unlike regular cameras, event-based ones only record moments when light becomes brighter or dimmer. They don't produce snapshots; instead, they send an endless stream of such flashes. Scientists turned this stream into a sharp picture of the Earth while flying over it on a satellite. Each flash is like a piece of a mosaic; together they form a still image.
Machine Learning2026-07-142 minarXiv:2607.12382express
gradCSCG: How an Algorithm Maps a Room by Mimicking a Child and Brain Neurons
A child exploring an unfamiliar apartment crawls from object to object and remembers what is visible from each corner. This is how the brain builds a mental map — an internal model of space. The gradCSCG algorithm works on the same principle: it receives a video stream from a camera and independently draws a map of the room, relying only on the changing images.
Computer Vision2026-07-141 minarXiv:2607.12874express
Synthetic Deception: How Fake Images Teach Computers to See the Truth
A cook who learns to cook from hand-drawn pictures risks ruining every dish. The same trap awaits computer vision: models need thousands of labeled images, but collecting them manually is expensive and tedious. Synthetic frames solve the problem, but only if they look real.
Image Processing2026-07-141 minarXiv:2607.13204express
How a Tomograph Gathers Shadows to See the Invisible
Tomographs don't produce ready-made pictures. They collect numerous 'shadows' — projections of innards from different angles or using various signals — and mathematically reconstruct a 3D picture from them.
Optics2026-07-112 minarXiv:2607.10295express
AI Finds a Recipe for Light Circuits
Building a light chip is like a game where you have to guide a beam through a maze of tiny mirrors and beam splitters. Each element acts like a railroad switch: it either lets light pass straight through or directs it to an adjacent track. The goal is to produce a specific light pattern at the output while using as few 'switches' as possible. Usually, engineers spend years finding the shortest route for each task.
cs.MA2026-07-012 minarXiv:2607.00910
Calibrating a Virtual City: The SIVE Experiment
The 120 residents of Montelago are not people but digital characters. Each, besides a name and biography, has three hidden coordinates: trust in municipal authorities, assessment of source credibility, perceived adequacy of information. These numbers are known to the creators but not to the system itself.
cs.HC2026-06-303 minarXiv:2607.00239
Retouching by the rules: where science ends and deception begins
On the screen is the result of a complex simulation: two planets collided, a shockwave ripples outward. A couple of clicks in an editor, and harsh shadows soften, noise smooths out, the background darkens. This kind of digital retouching (image editing to enhance appearance) has long been part of the scientist’s toolkit.
Disordered Systems2026-06-131 minarXiv:2606.15344express
Light Condensate Learns to Draw Digits
Generative neural networks that create images typically rely on digital randomness. But a team of researchers built a system where randomness is born not in code, but in a tiny optical cavity filled with an organic dye.
Molecular Ballet Without a Choreographer
A dance of hundreds of particles: some pairs spin slowly and gracefully, others twitch in a frantic rhythm. To understand the essence of the dance, you need to watch the slow movements: they are the main choreography of the system. In molecular science, such slow movements are called 'slow modes,' and they determine how a protein folds into a ball or how a drug binds to its target.
Machine Learning2026-05-302 minarXiv:2606.00892express
How a Digital Twin Saves a Brain in Minutes
A plumber clears a clog in a narrow, winding pipe — by feel, without seeing inside. That's roughly how a surgeon feels during mechanical thrombectomy, the operation to remove a blood clot from a brain vessel. Time is short, and every move can either save a life or damage the vessel wall.
Quantum Physics2026-05-251 minarXiv:2605.25986express
Quantum Generator: Images Without Training
Conventional neural networks learn from thousands of examples, burning hours and gigawatts. Physicists have found a quantum workaround. As early as Max Planck showed the discreteness of energy, today this allows generation without training.
Medical Physics2026-05-231 minarXiv:2605.26151express
Muscle Fatigue Visible Without a Touch
Your arm lifts a cup from the shelf — a familiar motion you don't notice until muscles tire. Then the trajectory changes: the elbow shifts slightly, the hand trembles. A doctor usually catches these changes by hand, feeling the patient's muscles.
Handwriting Without an Alphabet: How the Brain Draws Letters It Has Never Seen
The hand traces the word "mom" in the air — familiar arcs and strokes. The brain, meanwhile, is not flipping through a photo of each letter. It launches a chain of simple movements.
Neurons Speak Plain Language
An artist paints a picture, glancing at the audience in the hall. If the viewer smiles, the artist adds more red and rounded lines to the canvas; if the viewer frowns, the artist removes blue and sharpens the angles.
Mesoscale2026-04-161 minarXiv:2604.14737express
Artificial atoms gain new orbitals
A wafer-thin film of organic molecules was grown on a silicon substrate. In this film, as if on a sheet of graph paper, tiny "pens"—artificial atoms — were laid out with the tip of a scanning tunneling microscope.
Quantum Physics2026-04-151 minarXiv:2604.13872express
Dance of Ions: How Quantum Vortices Are Born
In a field trap, scientists assembled a crystal — 150 ions at ultra-low temperature. Each ion behaves like a tiny magnet, capable of rotating in any direction. By controlling forces that depend on this rotation, physicists made all the magnets swirl into a common vortex called a skyrmion.
Quantum Physics2026-04-091 minarXiv:2604.07782express
Picture from Nothing: Silence Paints Ghosts
A drummer stays silent, but from the pauses you can tell where he didn’t hit. Similarly, physicists built an image by catching not light, but moments of absolute darkness. The picture emerged from silence. In the experiment, they shone light from an ordinary lamp onto the object.
Mesoscale2026-03-081 minarXiv:2603.07706express
How to See a Molecule's Shape Under a Microscope
A scanning tunneling microscope probes a molecule with an ultra-fine tip and maps its relief. But the image is flat, while the molecule is three-dimensional. How do you guess a person's pose from their shadow on a wall?
Materials2026-02-241 minarXiv:2602.20432express
Robot Chemist Hunts for the Perfect Film
A chef tastes the soup after every pinch of salt and instantly decides what to add next. That's roughly how the new setup for growing thin crystalline films works — except instead of taste, it uses an image from an electron microscope, and instead of a chef, a computer program.
Instrumentation2026-02-231 minarXiv:2602.19814express
Materials2026-01-241 minarXiv:2601.17253express
Neural Network Distinguishes Real Crystals from Fantasies
Porous zeolite minerals work like tiny sponges with holes of a strictly defined size. Through such holes, molecules of one kind pass while others get stuck: this is the basis for water purification, gas separation, and catalysis in petrochemistry.
Medical Physics2026-01-141 minarXiv:2601.09235express
Digital Twins Teach the CT Scanner
Computed tomography is like an X-ray that takes hundreds of images from different angles and stitches them into a 3D picture of the body. But each image delivers a small dose of radiation, and doctors need to know how much each organ receives. Currently, this is often estimated roughly using average tables rather than for the specific patient.