The Musical Horizon: How a Song Gains Dimension express
A conductor holds not a baton but a brush, and each stroke gives birth to color and form. New technology works the same way: it transforms a song's mood into a panoramic video that surrounds the listener.
First, the algorithm decomposes the track into emotions, similar to how light is analyzed by spectrum. Every four bars, it determines how joyful and energetic the music is, just two numbers. Then these values turn into the brightness and saturation of the frames, while sharp transitions add unpredictability to the picture. Brightness is matched with the precision of light measurements. The result is a film where you can look around as if you're standing inside a music box.
Interestingly, the system ignores song lyrics and doesn't copy music videos. It conveys a pure emotional arc — from quiet sadness to explosive energy. This is how music becomes visible and immersive.
Original abstract
as written by the authors arXiv:2607.13471
Music visualization offers a powerful way to enhance listeners' understanding and experience of music by translating auditory signals into visual forms. However, most existing approaches either rely heavily on lyrics or generate flat, non-immersive videos similar to conventional music videos, which limits their ability to convey the emotional dynamics of music and provide an immersive listening experience. We propose Bring Music The Horizon, an emotion-aware pipeline for music-driven 360$$^\circ$$ video generation. Given an input song, our work first estimates its emotional trajectory by predicting valence-arousal values at the level of every four bars. These values are then converted into emotion-aware visual guidance using EmotiCrafter, and these guidance vectors can be manipulated by the SEGA framework, which provides fine-grained semantic control for keyframe generation. Finally, image-to-video models are applied to the generated keyframes to synthesize temporally continuous 360$$^\circ$$ videos for immersive music visualization. Our pipeline generates 360$$^\circ$$ music visualization videos that reflect the emotional progression and temporal structure of the input song. We demonstrate its capability using songs from different genres and provide qualitative comparisons with From-Sound-To-Sight, a representative audio-to-visual generation baseline, on our project page at https://etoile-et-toi-mp3.github.io/BMTH_Project_Page/.
Valence and arousal are the two scales psychologists use to describe any mood. The technology relies on them to translate music into color and motion.
In the future, musicians will be able to create not just albums but entire virtual worlds you can step into.