concept

spectrogram

A visual representation of sound frequency changes over time, used as input for the neural network.
22 related articles

Description

A spectrogram is a visual representation of how the frequency content of a signal changes over time. Instead of showing a single waveform, it displays a two-dimensional image where one axis represents time, the other represents frequency, and the brightness or color at each point indicates the intensity (amplitude) of that frequency at that moment. This makes it an incredibly powerful tool for analyzing sounds, radio waves, and any other signal that varies in time, revealing patterns that are invisible in the raw waveform.

History

The concept evolved from early sound analysis techniques in the mid-20th century, particularly with the development of the sound spectrograph at Bell Labs in the 1940s, which was used for speech analysis.

How it works

The signal is divided into short overlapping time segments. Each segment is then processed with a mathematical operation called the Fourier transform, which decomposes it into its constituent frequencies. The resulting frequency magnitudes are plotted as a vertical column of colored pixels, and these columns are placed side by side to build up the full spectrogram image over time. This process is often called a short-time Fourier transform (STFT).

In practice

Spectrograms are used in speech recognition, music analysis, sonar and radar, medical imaging (like ultrasound), and as input data for neural networks that process audio or other time-varying signals.

Fun fact

Spectrograms can be used to hide secret messages in audio files, a technique known as audio steganography, where an image is embedded as a spectrogram that only appears when the audio is analyzed.

Concept graph →

Related articles · 22

Optics2026-09-072 minarXiv:2609.07934
Light as a Score: Photonic Chip Conducts Wave Packets
A conductor raises the baton, and the orchestra produces not just sound but a complex score: each note sounds at its own moment, at its own pitch, with the right volume. Light can also be a score, if you control its spectrum and timing. Previously, this required bulky setups that could not be reconfigured after assembly.
q-bio.BM2026-07-052 minarXiv:2607.04134express
A Protein Dances to the Music of Fourier
A protein in a cell is not a frozen sculpture. It is constantly in motion: bending, breathing, jittering. This motion, its dynamics, determines how the protein works. But peering directly into the dance is hard, and computer simulations often demand enormous computing power. A new approach, named DynaMode, views protein motion as a musical piece.
How the Brain and Heart Drift Apart in the Final Minutes
When the conductor leaves the orchestra, the musicians keep playing from memory for a while. But without a unified rhythm, each one starts to speed up or slow down on their own, and the harmonious symphony turns into disjointed noise. According to new research, the brain and heart behave much the same way in the last hours of a person's life.
Cosmology2026-06-083 minarXiv:2606.09210express
Dark Matter Sings in Two Voices
An ultra-sensitive microphone listens not to sound, but to the trembling of space itself. That's how gravitational wave detectors work — LIGO, Virgo, KAGRA.
General Relativity2026-05-222 minarXiv:2605.24145express
Neutron Stars Reveal Their Secrets Through Gravitational Waves
Two ultra-dense stars spiral around each other and eventually collide. This dance lasts only moments, but it sends powerful ripples through space — gravitational waves. After the merger, a rapidly spinning blob remains, ringing like a bell, and that ring carries information about what the stars were made of.
Optics2026-05-152 minarXiv:2605.15632express
Light Flipped in Time
A pebble tossed into a pond sends ripples spreading in all directions. Now imagine the pond itself suddenly turning into jelly — instantly, faster than the wave can complete a single crest. Some ripples would keep spreading but change their spacing, while others would unexpectedly turn around and run back toward the point of impact, as if time were flowing backward for them.
Chemical Physics2026-05-092 minarXiv:2605.08708express
Why the Same Material Glows Differently
A squad of soldiers marches across a parade ground. As long as everyone keeps in step, the movement remains sharp and coordinated. But if someone falls out of line, the order is lost. In the microworld, electrons play the role of such a squad: when their oscillations are synchronized, the substance emits a narrow, sharp line.
General Relativity2026-04-252 minarXiv:2604.23364express
The Spectral Butterfly Effect in Thick Branes
Gravitational wave detectors work like sensitive microphones, picking up the trembling of space from distant cosmic catastrophes. When two black holes merge into one, the newborn object rings like a bell, and that ringing is a unique 'voice' of gravity.
Atomic Nuclei Measure Gravity
A clock isn't just hands. Every atomic nucleus is a natural metronome: it oscillates with nearly perfect regularity. If you lift one such metronome a couple of meters, its rhythm speeds up ever so slightly — that's time warping, as predicted by Einstein.
Optics2026-03-192 minarXiv:2603.18365express
A Camera That Sees Color and Motion at Once
A regular camera captures the world as a series of frames: twenty-four, sixty, or even a hundred images per second. That's enough for filming a falling drop, but inside a living cell, events unfold a thousand times faster. Protein molecules carry cargo, membranes bubble, ions slip through channels — all in fractions of a millisecond.
Chemical Physics2026-03-181 minarXiv:2603.18291express
Why Molecules Don't Sing Just One Note
Strike a tuning fork, and it rings with a single pure note. But if the fork is trembling and people are chattering nearby, the sound won't be perfect. Same with molecules: each one absorbs light of a specific color, but due to its own vibrations and the jostling of neighbors, that color gets smeared out. The authors of the paper figured out how to show this to students without complex formulas.
Optics2026-03-072 minarXiv:2603.07124express
Light Changes Color as It Passes Through a Vibrating Grating
A beam of light passing through a transparent plate usually keeps its color. But if you stack the plate from thin alternating layers, it becomes a grating that reflects and transmits waves selectively. This has long been used in lasers and optical filters. Now such gratings have been made to vibrate, and light started changing color.
Medical Physics2026-02-221 minarXiv:2602.19264express
A Carpet of Heartbeats
The heart beats, and on a paper ECG strip, each beat looks like a sharp spike with two humps: a quick rise, then a smaller wave, then a descent. A doctor looks at such a strip and sees the rhythm, but the shape of each spike, how exactly the muscle contracted, is hard to discern, especially if the recording lasts a full day. This new method turns that strip into a colorful carpet.
Optics2026-02-142 minarXiv:2602.13907express
Frequency Combs Catch Light That Used to Slip Away
An ordinary comb parts hair into even strands. A laser 'comb' does the same to light: it emits not one color but thousands, spaced at exactly equal frequency steps. Such a tool has already helped measure time to billionths of a second and peer inside atoms.
Medical Physics2026-02-031 minarXiv:2602.03744express
Spectromicroscopy: Seeing the Unseen in Just 4% of Measurements
A chemical map of a sample is like a mosaic: each point has its own color, its own chemical composition. To assemble such a mosaic, a spectromicroscope scans the sample point by point, recording a spectrum at each location — a "fingerprint" of how the material absorbs or emits light.
Optics2026-01-182 minarXiv:2601.12228express
A Spectrometer That Fits in Your Palm
A conventional spectrometer is like a comb that untangles light and sorts it by wavelength. But a comb is rigid: one type of light needs one comb, another needs a different one. The new device works differently. It asks light a series of questions, changing its shape each time to glean more meaning from the answers.
Medical Physics2026-01-181 minarXiv:2601.12437express
Sound Beam Passes Through the Skull and Twists
Sound can do more than be heard: it can push. An ultrasound vortex is a sound wave twisted like a whirlpool in a shell: silence at the center, rotating pressure at the edges. Such a whirlpool can grab tiny particles and carry them without a touch.
Optics2026-01-171 minarXiv:2601.12162express
A Camera That Sees the Unseen
Light is like a many-voiced choir: color, direction of oscillation, and instantaneous changes all intertwine. An ordinary camera hears only one voice, while the rest are lost. Scientists have built a camera that listens to the entire choir at once, and from a single image understands what is happening.
The Secret of Warped Webs: A New Way to Compare Networks
Graphs are considered identical if their 'terrain' matches. Imagine two maps with mountains and valleys: even if drawn differently, the heights and steepness of slopes can be the same.
The Komoto Butterfly: How to Color a Fractal in Infinite Colors
A fractal that looks like a butterfly hides an order that is not visible at first glance. In the quantum world of one-dimensional quasicrystals described by the Komoto model, the energy spectrum forms a whimsical shape: the Komoto butterfly.
Neural Network Learns Spinfoam Amplitude
In 2008, a group of physicists spent months of supercomputer time to compute a single quantity in quantum gravity theory. This is the vertex amplitude of spinfoam, a number that sets the probability of a local quantum transition of spacetime.