How Machines Learn to Tell Speech Sounds Apart express

Original: "[b]=[d]-[t]+[p]: Self-supervised Speech Models Discover Phonological Vector Arithmetic"
arXiv:2602.18899 · 2026-02-21 · CC BY 4.0 · 1 min
A neural network trained on thousands of hours of speech stores sounds like arrows in a pocket: each arrow is a separate feature, and you can add them together.

A teacher in class explains the difference between 'dog' and 'tog': put your hand on your throat and feel the vibration. A speech recognition machine does much the same thing, except inside it's not a throat but long lists of numbers. It turns out these numbers can be sorted onto shelves, like alphabet blocks in a child's room.

Scientists took a model trained on 96 languages and found directions inside it that correspond to individual sound features. For example, there's a 'voicing' direction. If you take the vector for 'p' and add this vector, you get 'b'. If you add not the whole vector but half of it, you get a sound that's half-voiced, as if the speaker started to whisper but didn't finish.

A vector is just a list of numbers that describes a sound's position in the model's space. Adding such lists is like walking on a map: take a step north, then east, and you end up in a new place.

This discovery has practical value. If we understand how sounds are organized inside the model, we can better tune speech recognition for rare languages with few recordings. Or make voice assistants less likely to confuse 'cot' and 'got' in accented speech. The model has essentially been handed a phonetic atlas, and now it can travel through it deliberately, not by feel.

The study found that if you take the difference between 'd' and 't' and add it to 'p', you get 'b'. It's like subtracting 'tom' from 'dom' and getting the instruction 'make it voiced'.

Scientists
Andrey Markov
Concepts
speech recognition protein language model Large Language Models ai speech analysis self-supervised learning support vector machine labeled data genetic code voice assistant tensor 3d image