method

Generative Adversarial Networks

Generative adversarial networks are a machine learning method where two neural networks compete to generate realistic synthetic data.
62 related articles · 1 formulas

Description

GAN is an architecture of two neural networks playing a minimax game: generator G tries to fool discriminator D by creating plausible data, while D learns to spot fakes. Equilibrium occurs when G reproduces the real data distribution so accurately that D can no longer distinguish—its accuracy drops to random guessing (50%). Like an arms race between a counterfeit bill maker and a bank expert, each side raises the bar.

History

Proposed by Ian Goodfellow et al. (2014) as a way to train generative models without explicitly modeling the data distribution. The idea traces back to adversarial games and minimax theory. They quickly became popular due to their ability to generate realistic images, sound, and video. Subsequent modifications—DCGAN, StyleGAN, CycleGAN—addressed training instability issues and improved quality.

How it works

During training, G and D are updated alternately. The discriminator receives a real sample and the generator's output, computes its loss (logistic loss function). The generator adjusts its weights to maximize the discriminator's error—i.e., to make the fake appear real. Gradients from D flow back through G, shaping the latent representation. Problem: vanishing gradients if D is too strong, so non-standard loss functions (e.g., Wasserstein GAN) are often used.

In practice

Generating photorealistic faces, creating clothing designs, enhancing medical images — anywhere that requires plausibly filling in the details.

Fun fact

The most impressive deepfakes and old film restorations owe their existence to GANs.

Concept graph →

Formulas

$$\min_G \max_D V(D,G) = \mathbb{E}_{x \sim p_{data}}[\log D(x)] + \mathbb{E}_{z \sim p_z}[\log(1 - D(G(z)))]$$
Adversarial training objective for generative adversarial networks.
What is in the formula
xvariabledata sample — sample
zvariablelatent variable sample — latent variable
D(x)variablediscriminator output for real data — discriminator output
G(z)variablegenerator output for latent variable — generator output
V(D,G)variablevalue function of the game — value function
min_Goperatorminimize with respect to generator parameters — minimization over generator
max_Doperatormaximize with respect to discriminator parameters — maximization over discriminator
E_{x~p_data}operatorexpectation over the empirical data distribution — expectation over data distribution
E_{z~p_z}operatorexpectation over the latent prior distribution — expectation over latent distribution
logoperatornatural logarithm — logarithm
\min_g\max_dv(d,g)=\mathbb{e}_{x\simp_{data}}[\logd(x)]+\mathbb{e}_{z\simp_z}[\log(1-d(g(z)))] · 2606.27227

Related articles · 69

A Thermostat Without a Thermometer: How a Network Finds Its Own Critical Point
In a nine-story building with a thousand rooms on each floor, some people whisper and others shout. Neighbors pass the message along, but if everyone speaks too softly, the message fades by the third floor. If too loudly, by the top floor it becomes an unintelligible roar. Between these extremes, there is a regime where a whisper makes it all the way through without distortion.
A Translator That Can't Keep Up with Speech: How a Neural Network Accelerates Gravitational-Wave Astronomy
Imagine a simultaneous interpreter in a room where two people are speaking: they must keep up with both meaning and intonation, but if the speech is too fast, only a paraphrase remains. That's roughly how scientists feel as the stream of gravitational waves from black hole and neutron star mergers grows, while precise signal calculations lag behind.
A Translator That Can't Keep Up with Speech: How a Neural Network Accelerates Gravitational-Wave Astronomy
Imagine a simultaneous interpreter in a room where two people are speaking: they must keep up with both meaning and intonation, but if the speech is too fast, only a paraphrase remains. That's roughly how scientists feel as the stream of gravitational waves from black hole and neutron star mergers grows, while precise signal calculations lag behind.
Neural Computing2026-08-191 minarXiv:2608.18569express
Brain vs. the Mirror Maze
Getting lost in a hall of mirrors is easy: every wall reflects another, and you feel like you've been here before. The brain gets similarly confused when surrounded by many similar places. Neurons responsible for the spatial map can fire the same signal for two different corners of a room. This is called spatial ambiguity.
Division That Doesn't Fragment Memory
Holding in mind the exact position of a pen as it's slowly moved is a routine task for the brain. For artificial neural networks, it's nearly impossible. Standard recurrent networks like GRU and LSTM tend to break continuous motion into rigid steps: the pen doesn't glide smoothly but jumps from point to point.
Machine Learning2026-08-011 minarXiv:2608.00776express
Chemistry Looks at Molecules Through the Eyes of a Computer
Predicting the yield of a chemical reaction is a bit like trying to guess the harvest knowing only the soil composition. Traditionally, chemists have relied on long columns of numbers, quantum descriptors, that describe electron energies but say nothing about molecular shape.
Cosmology2026-07-312 minarXiv:2607.29683express
Neural Network Teaches Gravity Not to Hide
In the vast cosmic ocean, dark matter gathers into clumps and filaments, like plankton in currents. But if gravity doesn't work exactly as Einstein said, these patterns change — barely noticeably, like ripples from an invisible wind. You can spot such ripples by comparing sky maps with computer simulations.
Geophysics2026-07-232 minarXiv:2607.21854express
Seismic Echo Reveals Hidden Flows
A basin of wet sand. You press in one corner, and water starts moving. But how exactly? Instead of an even circle, it might spread in tongues, linger in some spots, and rush through others. Underground, the same thing happens: oil, water, or gas migrate through rocks not by the textbook, but following the chaos of fractures and heterogeneities.
AI Learns to Create Viruses
By 2025, large language models like GPT are no longer just chatting: they're helping scientists run experiments. But the same tool could fall into the wrong hands. A team of researchers built a digital proving ground to find out.
Signal Processing2026-07-161 minarXiv:2607.14505express
Smart Filter for Secret Keys: Autoencoder vs. Noise
When two phones try to create a shared secret key from random properties of radio waves, interference makes their measurements imprecise. It's like two people looking at a reflection in a fogged-up window: each sees a blurry silhouette, and there's no way to make out a common picture.
eess.AS2026-07-151 minarXiv:2607.13408express
How AI Stopped Mixing Up Sounds in a Script
Models that turn text into audio are good at recreating single sounds, but get confused when the script has several in a row. For example, the script might call for a ring, then footsteps, then a door slam. The generator might shuffle events, so the listener hears footsteps before the ring.
eess.SY2026-07-151 minarXiv:2607.13537express
Duo of Speed and Accuracy for Smart Power Grids
Solar panels and wind turbines, unlike old-school generators, connect through inverters, opening new loopholes for hackers: you can quietly falsify sensor readings or spoof GPS timestamps. To defend, engineers combined two approaches — an ultra-fast guardian and a thoughtful detective.
Signal Processing2026-07-141 minarXiv:2607.12744express
Position-savvy neural network improves connectivity
In a kitchen with gas burners, each heats differently. If the cook moves the pots, food may burn. Just so in a wireless network: the antenna-burners and user-pots require precise placement. Ordinary neural networks don’t distinguish positions, treating all burners as identical. So they struggle to estimate signal quality or adjust transmission.
Cosmology2026-07-143 minarXiv:2607.12745
The Chameleon Universe: How Gravity Learns to Hide
In the depths of space, gravity is mastering the art of disguise. For a quarter century, astrophysicists have been trying to decipher the nature of dark energy, which makes the Universe expand at an accelerating rate.
eess.AS2026-07-141 minarXiv:2607.12807express
How Headphones Learned to See the Source of Noise
Active noise cancellation creates 'anti-sound' to neutralize noise. But ordinary systems are blind: they don't know where the sound is coming from. In rooms with an echo, it's like boxing with a blindfold on — you're canceling blindly.
Robotics2026-07-141 minarXiv:2607.12861express
Invisible Map of a Robot Swarm
A robot swarm is like a cloud of fireflies: each moves on instinct to wherever is freer, and chaos turns into order. For a long time, it was a mystery how coherence emerges without communication or commands. The answer came with the creation of the Response Map — a tool that, like an X-ray, illuminates the hidden logic of the machine brain.
Computer Vision2026-07-141 minarXiv:2607.12874express
Synthetic Deception: How Fake Images Teach Computers to See the Truth
A cook who learns to cook from hand-drawn pictures risks ruining every dish. The same trap awaits computer vision: models need thousands of labeled images, but collecting them manually is expensive and tedious. Synthetic frames solve the problem, but only if they look real.
eess.SY2026-07-131 minarXiv:2607.11072express
Electric Cosmos on Rails
The railway overhead contact line resembles a galaxy: energy flows through it like gravity, with trains becoming planets. The more trains draw current simultaneously, the stronger the voltage fluctuations — gravitational waves ripple through the system, threatening blackouts.
Machine Learning2026-07-131 minarXiv:2607.11091express
Neighbor molecules improve prediction accuracy
Predicting the properties of a new molecule is like guessing the flavor of an unfamiliar dish. The program works like an experienced chef: it “tastes” similar molecules whose properties are already known, and based on their “flavor,” it refines its guess.
eess.SY2026-07-131 minarXiv:2607.11122express
Float Controller: Stability via an Instant Equation
The float in a toilet tank is an ideal controller: sensing the water level, it instantly brings the system into equilibrium without looking back at the past. Engineers applied this principle to neural networks.
Language Amnesia in Neural Networks: A Solution Exists!
A large neural network like Whisper masters hundreds of languages and resembles the standard model of the universe: everything is balanced. But training on a rare language disrupts this equilibrium — it turns into a black hole, pulling in all training resources. The network starts forgetting the other languages.
Cosmic Palimpsest: Gravitational Waves Reveal the Story of Ancestor Black Holes
The universe rewrites its history again and again. Where ordinary astronomy sees only a point, a black hole, gravitational waves peel back thin layers of the past, like an ancient palimpsest. The idea that black holes can grow by devouring each other, and their offspring can enter new unions, has been discussed by astrophysicists for half a century.
cs.MA2026-07-012 minarXiv:2607.00910
Calibrating a Virtual City: The SIVE Experiment
The 120 residents of Montelago are not people but digital characters. Each, besides a name and biography, has three hidden coordinates: trust in municipal authorities, assessment of source credibility, perceived adequacy of information. These numbers are known to the creators but not to the system itself.
cs.SI2026-07-012 minarXiv:2607.01148
How Weak AI Agents Take Over Networks: The Crystallization of Inequality
A tiny dust particle in a supersaturated solution sprouts into a large crystal in seconds. Neighboring particles remain invisible. A similar process was recently discovered in communities of language agents.
The Shadow Theater of LIGO: A Neural Network Fabricating Deceptive Glitches
The LIGO and Virgo detectors catch gravitational waves from mergers of black holes and neutron stars. But among the cosmic signals, their sensitive arms are constantly crossed by shadows — short-lived noise artifacts, glitches, that stage a true shadow theater.
q-bio.PE2026-06-191 minarXiv:2606.21351express
How Antibodies Learn: A Map of Beneficial Mutations
The immune system is like a tireless editor, revising antibody drafts to make them stickier to viruses and bacteria. This process is called antibody maturation: random typos (mutations) arise in the genes, and natural selection keeps those that improve target capture.
Instrumentation2026-06-151 minarXiv:2606.16922express
A neural network learns to see invisible polarization
X-ray detectors work like honeycombs: particles flash here and there in hexagonal cells. Conventional algorithms stretch these combs onto a square grid, creating ghostly polarization artifacts. Scientists used a neural network that lives by the rules of the hive — it processes the hexagonal structure directly, preserving the natural pattern.
Disordered Systems2026-06-131 minarXiv:2606.15344express
Light Condensate Learns to Draw Digits
Generative neural networks that create images typically rely on digital randomness. But a team of researchers built a system where randomness is born not in code, but in a tiny optical cavity filled with an organic dye.
Molecular Ballet Without a Choreographer
A dance of hundreds of particles: some pairs spin slowly and gracefully, others twitch in a frantic rhythm. To understand the essence of the dance, you need to watch the slow movements: they are the main choreography of the system. In molecular science, such slow movements are called 'slow modes,' and they determine how a protein folds into a ball or how a drug binds to its target.
A Genetic Anchor for Health
You buy a new kitchen scale, but instead of exact weight, it only shows deviations from some "norm." To find out how much an apple weighs, you first have to weigh dozens of other apples and calculate the average.
Machine Learning2026-06-061 minarXiv:2606.08287express
A neural network that senses stress in parts of any shape
Designing machines is like cooking: you need to know exactly where the 'dough' will tear. Old computer simulations check every point on a part for hours, like measuring the entire pot to make sure the handle doesn't fall off.
HEP Phenomenology2026-05-262 minarXiv:2605.27519express
Gravitational Waves Hunt for Traces of Neutrino Birth
The universe sometimes resembles a pot of boiling water. With enough heat, liquid turns to vapor: that's a phase transition. Something similar could have happened in the early universe: a field filling space suddenly changed its state, like water becoming gas.
Quantum Physics2026-05-251 minarXiv:2605.25986express
Quantum Generator: Images Without Training
Conventional neural networks learn from thousands of examples, burning hours and gigawatts. Physicists have found a quantum workaround. As early as Max Planck showed the discreteness of energy, today this allows generation without training.
General Relativity2026-05-222 minarXiv:2605.24145express
Neutron Stars Reveal Their Secrets Through Gravitational Waves
Two ultra-dense stars spiral around each other and eventually collide. This dance lasts only moments, but it sends powerful ripples through space — gravitational waves. After the merger, a rapidly spinning blob remains, ringing like a bell, and that ring carries information about what the stars were made of.
Machine Learning2026-05-201 minarXiv:2605.21164express
Quantum Assistant Detects Rare Frauds
In the ocean of bank transactions, fraud is rarer than neutron stars in space, just 0.1% of all operations. A conventional detector gets used to the clean flow and loses vigilance. Enter Q-SYNTH, a hybrid system with a quantum generator. It creates plausible fake transactions itself, drawing on scraps of real data.
Pixel Rain: How to See a Downpour Where There Was None
A mosaic of large colored tiles. Each tile is the average precipitation over an entire month for an area the size of a small country. For a general understanding, the picture is fine, but if you need to know whether a downpour hit a specific city yesterday, it's useless.
General Relativity2026-05-111 minarXiv:2605.11280express
General Relativity2026-05-042 minarXiv:2605.02453express
How to Hear a Crack in the Fabric of the Universe
The symphony plays, but a barely perceptible wrong note has crept into the score. This is roughly how physicists search for deviations from general relativity in the 'sounds' of the universe — gravitational waves from merging black holes.
Chemical Physics2026-04-292 minarXiv:2604.27070express
Neural Network Learns to Read Molecules by Their Carbon Signature
Every carbon atom in a molecule carries a passport — the energy with which its deepest electrons sit in their orbitals. This energy is sensitive to neighbors: add an oxygen nearby or a double bond, and the number in the passport changes. Chemists have long measured such energies with X-rays, but calculating each new molecule takes hours of machine time.
Machine Learning2026-04-262 minarXiv:2604.23758express
Crystals Under the AI Microscope: How a Machine Found 68,000 New Superconductors
Searching for a new material is like looking for a needle in a haystack, but here the haystack is millions of possible atomic combinations. In the past, scientists spent years trying out options in the lab, relying on intuition and luck. Now, artificial intelligence is stepping in, learning to 'understand' the language of crystals.