concept

speech recognition

The process by which a machine identifies and understands spoken words from audio signals.
78 related articles

Description

Speech recognition is the technology that enables machines to convert spoken language into text or commands. It involves analyzing audio signals, extracting acoustic features, and mapping them to linguistic units like phonemes and words. Modern systems use deep neural networks trained on vast amounts of speech data to achieve near-human accuracy, even in noisy environments or with diverse accents.

History

Early attempts in the 1950s used simple pattern matching for digits. The field advanced with hidden Markov models in the 1980s, but the breakthrough came in the 2010s when deep learning replaced traditional acoustic models, dramatically improving accuracy.

How it works

The process begins with digitizing the audio waveform and dividing it into short frames (e.g., 25 ms). For each frame, features like Mel-frequency cepstral coefficients (MFCCs) are extracted, capturing the spectral shape of the sound. These feature vectors are fed into a neural network — often a recurrent or transformer architecture — that outputs probabilities over possible phonemes or characters. A language model then combines these probabilities with linguistic constraints to produce the most likely text sequence. Recent end-to-end models (e.g., Whisper, DeepSpeech) learn the entire mapping from audio to text directly, bypassing explicit phoneme alignment.

In practice

Speech recognition powers virtual assistants (Siri, Alexa), automated transcription services, voice-controlled devices, and real-time captioning for the hearing impaired.

Fun fact

Modern speech recognition systems are so sensitive that they can be tricked by inaudible ultrasonic commands hidden in audio recordings, a security vulnerability discovered in 2017.

Concept graph →

Related articles · 78

Scales for Thoughts: How to Measure Whether a Neural Interface Really Speaks
In the 1980s, the DARPA speech recognition challenge settled the debate between statistical methods and hand-written rules, setting a common standard for the entire field.
How the Visual Cortex Conducts the Thalamus
The brain is like an orchestra, with the cortex as the conductor and the thalamus as the first violin. The thalamus relays signals from the eyes to the visual cortex. But the cortex can also send commands back, tuning the thalamus for the task at hand. This was once a hypothesis, but now it's been tested in humans.
Materials2026-08-161 minarXiv:2608.15928express
AI hunts for materials like a head chef
Hunting for a new material is like cooking without a recipe: you try, try again, and often throw things out. Previously, scientists manually flipped through papers and tested compositions one by one. Now there's a "robot chef" that reads the literature itself, mixes components, and checks what came out.
Machine Learning2026-08-022 minarXiv:2608.01481express
Reading Thoughts from Magnetic Fields
A magnetoencephalograph, a helmet-like device with hundreds of sensors, picks up the weak magnetic fields generated by active neurons. When a person listens to speech, these signals contain imprints of the heard words. But extracting them is tricky: signals from thousands of sources merge into a tangled mess.
Stellar2026-07-273 minarXiv:2607.24525
How a Neural Network Learns to Read the Sun’s Magnetic Tapestry
Each morning, dozens of telescopes swing toward the Sun. Their cameras catch a narrow band of red light — the Hα line, discovered by Johann Balmer. The images reveal dark, whimsically curved threads. They look like stitches in a giant tapestry sewn through the blazing corona.
How Ideas Learn from Each Other
The human mind is like a construction set that builds itself. New ideas don't die with their creators: they are passed on, mixed, and selected. This process is called cultural evolution: useful inventions stick, useless ones are forgotten. That's how a ratchet works — a mechanism that only turns forward. But what exactly happens in the head when one thought displaces another?
Stellar2026-07-193 minarXiv:2607.17348
SpecFANN: Lightning-Fast Sketch of a Star's Spectrum
An artist makes a quick charcoal sketch, and the face in the portrait is already recognizable. Astrophysicists face a similar challenge: the spectrum of a star is its individual portrait, revealing temperature, composition, and gravity.
Signal Processing2026-07-161 minarXiv:2607.14505express
Smart Filter for Secret Keys: Autoencoder vs. Noise
When two phones try to create a shared secret key from random properties of radio waves, interference makes their measurements imprecise. It's like two people looking at a reflection in a fogged-up window: each sees a blurry silhouette, and there's no way to make out a common picture.
eess.SY2026-07-161 minarXiv:2607.14606express
How to read an enemy in the sky in seconds
In combat, a pilot needs to instantly understand what an object is and what its intentions are. Conventional systems wait for complete radar data — like a goalkeeper who only reacts after the shot. The new algorithm works like an experienced goalkeeper: from the attacker's first moves, it predicts the target's maneuver.
Signal Processing2026-07-161 minarXiv:2607.14938express
Where Are You? Radio Waves Know the Answer
Radio signals in a room act just like sound in a concert hall: bouncing off walls and objects, they create a unique pattern — a silent melody for every location. Your phone, like a keen ear, catches this melody amid noise and distortion. It remembers which chord matches the corner of the couch, and which one fits the doorway.
eess.AS2026-07-161 minarXiv:2607.15198express
How to fish out a friend's voice from a noisy conversation
A human effortlessly picks out the desired voice from the clamor of a party. For a computer, the same task is still at the edge of its abilities. Previous programs trained on sterile recordings, free of echo or the clinking of appliances.
eess.AS2026-07-161 minarXiv:2607.15243express
The Illusion of Accuracy: How AI Testing in Acoustics Misleads
An AI predicting room acoustics is like a student taking an exam with a cheat sheet. If the test points are the same as the training ones, the model simply memorizes the acoustic 'fingerprint' of each position — like a student recognizing a question by the dog-eared corner.
eess.AS2026-07-151 minarXiv:2607.13408express
How AI Stopped Mixing Up Sounds in a Script
Models that turn text into audio are good at recreating single sounds, but get confused when the script has several in a row. For example, the script might call for a ring, then footsteps, then a door slam. The generator might shuffle events, so the listener hears footsteps before the ring.
Signal Processing2026-07-151 minarXiv:2607.13463express
Untangling Layered Radio Modulation: The TSDN Method
A radio signal with layered modulation resembles the cultural layer of an ancient city: each level carries its own information, but over time they get jumbled by interference. Conventional algorithms get lost in this mess. The new TSDN method acts as a neural network archaeologist.
cs.SD2026-07-151 minarXiv:2607.13477express
AI Judges Listen Not with Ears, but with Labels
Automatic speech judges are algorithms that evaluate pronunciation and emotions. However, they often work like a food critic who delivers a verdict after reading the menu but not tasting the dish.
Computer Evaluated Pronunciation Without Any Hints
Learning a foreign language is like tuning a musical instrument. The new technology works like a smart tuner: it takes your recording and a native speaker's reference speech, stretches or compresses them in time (like adjusting a string) to align them precisely, and evaluates three key parameters: clarity of sounds, rhythmic precision, and intonation.
Machine Learning2026-07-151 minarXiv:2607.14086express
Brain Signals: Learning to Understand Without a Teacher
The brain communicates in short electrical clicks. Previously, to learn this language, thousands of examples with translations from the experimenter were needed. MOJO takes a different path: like learning a language through immersion, it first listens to the 'stream of consciousness' without any hints and finds recurring patterns on its own.
eess.AS2026-07-151 minarXiv:2607.14310express
Cooking a Living Voice: The Russian Dataset That Teaches Assistants to Feel
Voice assistants often sound like a chef reading a recipe from a card with zero appetite. The new Russian dialogue archive, “Dialogues,” flips the script: three studio actors, like master chefs, blended 20 hours of live conversation with twelve emotional “spices.” Each line got tagged for style and emotion — creating a complete book of flavors.
Machine Learning2026-07-142 minarXiv:2607.12417express
A Neural Network That Perceives Phase: From Hearing to Quantum Computing
A sound signal is conveniently represented as a complex number: its modulus (amplitude) reflects loudness, while its argument (phase) indicates the wave's position in time: its instantaneous shift.
eess.AS2026-07-141 minarXiv:2607.12529express
Hearing Aids Learn to Taste Sound
Traditional hearing aids resemble a chef who cooks from a recipe blindly. They analyze the sound chaos from the microphone and amplify speech based on it. In a noisy café, this approach often errs. The new system behaves like an experienced cook: first processes the signal, then samples the result.
eess.AS2026-07-141 minarXiv:2607.12647express
How a Computer Learns to Hear Everyone in a Noisy Room
In a noisy room, a person picks out a desired voice thanks to two ears capturing the difference in sound arrival. A computer with several microphones does the same: it gets spatial cues — where each voice is coming from. Previously, these cues were used to focus on one direction, like a flashlight beam.
eess.AS2026-07-142 minarXiv:2607.12703express
Audio Diarization: How an Algorithm Catches Any Sound Event Without Prior Knowledge
Human hearing is wired so that the brain prioritizes familiar patterns — a friend's voice, the patter of rain, a car horn. But a new system works on a different principle: it registers any sound burst, even one never encountered before.
eess.AS2026-07-141 minarXiv:2607.13330express
How a Sound-Generating Neural Network Slimmed Down
A neural network that generates sounds from text is like a kitchen where dozens of chefs prepare each 'dish.' Many just get in the way — sending false signals and wasting resources.
Computer Vision2026-07-131 minarXiv:2607.11120express
Doubt is Given Away by Silence: AI Reads the Pauses
A new system analyzes a short interview to recognize human doubt by combining text, voice, and facial expressions. But the main key to uncertainty turned out to be the dark matter of speech — pauses and filler words that standard speech systems erase like a black hole.
eess.SY2026-07-131 minarXiv:2607.11122express
Float Controller: Stability via an Instant Equation
The float in a toilet tank is an ideal controller: sensing the water level, it instantly brings the system into equilibrium without looking back at the past. Engineers applied this principle to neural networks.
eess.AS2026-07-131 minarXiv:2607.11157express
Clean Sound: Why Volume Matters More Than Phase
Cleaning speech from noise is like tuning an old TV: twist the contrast knob too far, and faces become unnatural. Researchers separately adjusted the 'volume' and 'time shift' for each frequency of sound, as if splitting it into a rainbow — a method known as spectroscopy. It turned out the key knob is volume, not phase synchronization.
Language Amnesia in Neural Networks: A Solution Exists!
A large neural network like Whisper masters hundreds of languages and resembles the standard model of the universe: everything is balanced. But training on a rare language disrupts this equilibrium — it turns into a black hole, pulling in all training resources. The network starts forgetting the other languages.
eess.AS2026-07-131 minarXiv:2607.11260express
Sound Concentrate: Transmitting Speech Without Redundant Bits
The standard way of digitizing speech: taking volume readings thousands of times per second. It's like tasting broth with a teaspoon: each sip is watery, with almost no detail. The data stream swells, though the substance is minuscule. Scientists proposed first "simmering down" the audio signal.
cs.FL2026-07-013 minarXiv:2607.00742
The Odd-Jury Automaton: How Symmetric Difference Speeds Up Computation
In the courtroom, a string is presented as input. Twelve jurors (computation paths) examine it symbol by symbol. Each can render a 'guilty' (accept) or 'not guilty' verdict. For a conventional nondeterministic automaton (NFA), one 'yes' vote suffices.
cs.MA2026-07-012 minarXiv:2607.00910
Calibrating a Virtual City: The SIVE Experiment
The 120 residents of Montelago are not people but digital characters. Each, besides a name and biography, has three hidden coordinates: trust in municipal authorities, assessment of source credibility, perceived adequacy of information. These numbers are known to the creators but not to the system itself.
Squealer: When the Model Squeals, Rejecting Your Data
Statistical models are an attempt to stretch a perfect mathematical web over the uneven landscape of data. When a model resists, it emits tension, but we've grown accustomed to ignoring it. Researchers spend hours staring at residual plots, trying to guess where the model is 'coming apart at the seams.' Squealer translates this resistance into sound.
Applied Physics2026-05-302 minarXiv:2606.00818express
Silicon Retina: A Neuron Learns to See Like an Eye
A smartphone camera captures everything indiscriminately, but the eye immediately picks out what matters. The retina doesn't just pass the image to the brain: it highlights contours on the spot, suppresses noise, and adjusts to brightness.
q-bio.QM2026-05-221 minarXiv:2605.23745express
A Chemical Computer in a Test Tube
Molecules float in a test tube. Their abundance (say, the concentration of some protein) becomes the input signal. And the output isn't just a cloudy solution but a clear yes-or-no answer. The authors build a chemical cascade that does exactly that.
Computer Vision2026-05-221 minarXiv:2605.24273express
How to Track Down an Invisible Fugitive from Space
The MethaneSAT satellite scans for leaks of метана — a gas that's invisible but packs a powerful planetary warming punch. Its "nose" is a спектрометр, a device that spots the subtlest color changes in light passing through the atmosphere — the telltale sign of methane.
Handwriting Without an Alphabet: How the Brain Draws Letters It Has Never Seen
The hand traces the word "mom" in the air — familiar arcs and strokes. The brain, meanwhile, is not flipping through a photo of each letter. It launches a chain of simple movements.
physics.data-an2026-05-171 minarXiv:2605.17518express
How chemical logic rescues spectra from noise
A spectrum is like a photograph of a material's inner workings, taken with light. When a beam passes through or reflects off a sample, molecules leave characteristic dark bands, peaks, on that photograph. But if the image is overexposed or veiled in gray, making out details becomes nearly impossible.
Neurons Speak Plain Language
An artist paints a picture, glancing at the audience in the hall. If the viewer smiles, the artist adds more red and rounded lines to the canvas; if the viewer frowns, the artist removes blue and sharpens the angles.
How the Brain Learns to Look Ahead
A melody plays, and the brain doesn't just listen note by note. It works like a conductor who already knows the score: each next note is expected because the previous ones still echo in memory. But how do neurons hold on to that echo?
Thinking Aloud Helps Decode How We Take Risks
Every time you mull over a risky move, whether to invest in stocks or hold off, an inner dialogue runs through your head. Usually, scientists try to reconstruct that dialogue from the final choice alone, as if a detective were reconstructing a conversation between two people from a photo of the meeting spot.