Music visualization or music visualisation, a feature found in electronic music visualizers and media player software, generates animated imagery based on a piece of music. The imagery is usually generated and rendered in real time and in a way synchronized with the music as it is played. Visualization techniques range from simple ones (e.g., a simulation of an oscilloscope display) to elaborate ones, which often include a number of composited effects. The changes in the music's

loudness In acoustics, loudness is the subjective perception of sound pressure. More formally, it is defined as, "That attribute of auditory sensation in terms of which sounds can be ordered on a scale extending from quiet to loud". The relation of phys ...

and frequency spectrum are among the properties used as input to the visualization. Effective music visualization aims to attain a high degree of visual

correlation In statistics, correlation or dependence is any statistical relationship, whether causal or not, between two random variables or bivariate data. Although in the broadest sense, "correlation" may indicate any type of association, in statisti ...

between a musical track's spectral characteristics such as frequency and

amplitude The amplitude of a periodic variable is a measure of its change in a single period (such as time or spatial period). The amplitude of a non-periodic signal is its magnitude compared with a reference value. There are various definitions of a ...

and the objects or components of the visual image being rendered and displayed.

Definition

Music visualization can be defined, in contrast to previous existing pre-generated music plus visualization combinations (as for example

music videos A music video is a video of variable duration, that integrates a music song or a music album with imagery that is produced for promotional or musical artistic purposes. Modern music videos are primarily made and used as a music marketing devi ...

), by its characteristic as being real-time generated. Another possible distinction is seen by some in the ability of some music visualization systems (such as Geiss' MilkDrop) to create different visualizations for each song or audio every time the program is run, in contrast to other forms of music visualization (such as

or a

laser lighting display A laser lighting display or laser light show involves the use of laser light to entertain an audience. A laser light show may consist only of projected laser light beam, beams set to music, or may accompany another form of entertainment, ty ...

) which always show the same visualization. Music visualization may be achieved in a 2D or a 3D coordinate system where up to 6 dimensions can be modified, the 4th, 5th and 6th dimensions being color, intensity and transparency.

History

The first electronic music visualizer was the Atari Video Music introduced by

Atari Inc. Atari, Inc. was an American video game developer and home computer company founded in 1972 by Nolan Bushnell and Ted Dabney. Atari was a key player in the formation of the video arcade and video game industry. Based primarily around the Sunnyv ...

in 1976, and designed by the initiator of the home version of ''

Pong ''Pong'' is a table tennis–themed twitch arcade sports video game, featuring simple two-dimensional graphics, manufactured by Atari and originally released in 1972. It was one of the earliest arcade video games; it was created by Allan A ...

'', Robert Brown. The idea was to create a visual exploration that could be implemented into a Hi-Fi stereo system. In the

United Kingdom The United Kingdom of Great Britain and Northern Ireland, commonly known as the United Kingdom (UK) or Britain, is a country in Europe, off the north-western coast of the European mainland, continental mainland. It comprises England, Scotlan ...

music visualization was first pioneered by

Fred Judd Frederick Charles Judd (5 June 1914 - April 1992) was a British inventor, amateur radio operator, and proselytiser of early British electronic music. Early career Like fellow composer Tristram Cary, Fred served in the forces during World War ...

. Music and audio players were available on early home computers, ''Sound to Light Generator'' (1985, Infinite Software) used the

ZX Spectrum The ZX Spectrum () is an 8-bit home computer that was developed by Sinclair Research. It was released in the United Kingdom on 23 April 1982, and became Britain's best-selling microcomputer. Referred to during development as the ''ZX81 Colou ...

's cassette player for example. The 1984 movie '' Electric Dreams'' prominently made use of one, although as a pre-generated effect, rather than calculated in real-time. For PC/ DOS one of the first modern music visualization programs was the

open-source Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use the source code, design documents, or content of the product. The open-source model is a decentralized sof ...

, multi-platform '' Cthugha'' in 1993. In the 1990s the emerging demo and tracker music scene pioneered the real-time technics for music visualization on the PC platform; resulting examples are ''Cubic player'' (1994), ''Inertia Player'' (1995) or in general their real-time generated Demos. Subsequently, PC computer music visualization became widespread in the mid to late 1990s as applications such as ''

Winamp Winamp is a media player for Microsoft Windows originally developed by Justin Frankel and Dmitry Boldyrev by their company Nullsoft, which they later sold to AOL in 1999 for $80 million. It was then acquired by Radionomy in 2014. Sin ...

'' (1997), ''

Audion The Audion was an electronic detecting or amplifying vacuum tube invented by American electrical engineer Lee de Forest in 1906.De Forest patented a number of variations of his detector tubes starting in 1906. The patent that most clearly covers ...

'' (1999), and '' SoundJam'' (2000). By 1999, there were several dozen

freeware Freeware is software, most often proprietary, that is distributed at no monetary cost to the end user. There is no agreed-upon set of rights, license, or EULA that defines ''freeware'' unambiguously; every publisher defines its own rules for t ...

non-trivial music visualizers in distribution. In particular, '' MilkDrop'' (2001) and its predecessor "geiss-plugin" (1998) by Ryan Geiss, ''G-Force'' by

Andy O'Meara Andy may refer to: People *Andy (given name), including a list of people and fictional characters *Horace Andy (born 1951), Jamaican roots reggae songwriter and singer born Horace Hinds *Katja Andy (1907–2013), German-American pianist and piano ...

, and AVS (2000) by Nullsoft became popular music visualizations. AVS is part of

and has been recently

d, and G-Force was licensed for use in iTunes and

Windows Media Center Windows Media Center (WMC) is a defunct digital video recorder and media player created by Microsoft. Media Center was first introduced to Windows in 2002 on Windows XP Media Center Edition (MCE). It was included in Home Premium and Ultimate ...

and is presently the flagship product for Andy O'Meara's software startup company, SoundSpectrum. In 2008, iTunes added the "Magnetosphere" visualizer created by The Barbarian Group.

Use by deaf people

There have been applications of electronic music visualization in order to enhance the music listening experience for deaf and hard of hearing people. Richard Burn, a PhD candidate at Birmingham City University, is currently researching a device that displays detailed visual feedback from electronic instruments. These visuals will provide information on the specifics of what is being played, such as the pitch and the harmonics of the sound. This allows deaf musicians to better understand what notes they are playing, which enables them to create music in a new way. Researchers from the National University of Singapore have also created a device that will enhance musical experiences for deaf people. This technology combines a music display and haptic chair that integrates sound qualities from music into vibrations and visual images that correlate to the specific qualities found within the music. The visual display shows various shapes that change size, color, and brightness in correlation with the music. Combining this visual display with a haptic chair that vibrates along with the music gives a more all-around experience of music to those hard of hearing. Music visualization can also be used in education. The Cooper Union in NYC is using music visualization to teach deaf children about sound. They have developed an interactive light studio in the American Sign Language and English Lower School in NYC. This consists of an interactive wall display that shows digital output created by sound and music. Children can trigger the playing of instruments with their movement, and they can watch the visual feedback from this music. They are also able to view a "talking flower" wall, in which each flower can transform sound into light based on the specific frequencies of the sounds.

List of electronic music visualizers

*'' Atari Video Music'', designed by the initiator of the home version of ''

'', Robert Brown, and introduced by

in 1976. *''Pixelmusic 3000'', open source music visualizer on a microcontroller, made by Uncommon Projects in 2008.

List of music visualization software

*''

Advanced Visualization Studio Advanced Visualization Studio (AVS), is a music visualization plugin for Winamp. It was designed by Winamp creator, Justin Frankel and was first shipped in version 2.0a4 with Winamp 2.61. ''AVS'' has a customizable design which allows users to c ...

'' (

Justin Frankel Justin Frankel (born 1978) is an American computer programmer best known for his work on the Winamp media player application and for inventing the Gnutella peer-to-peer network. Frankel is also the founder of Cockos Incorporated, which creates ...

) (Platform: Windows) *'' Cthugha'' (1993, Kevin "Zaph" Burfitt) (Platform: DOS, Winamp) *
G-Force
' (2000, SoundSpectrum) (Platforms: Multi-platform) *
Goom
' (2001, Jean Christophe Hoelt) (Platforms: Multi-platform) *'' Magic Music Visuals'' (2012–2022, Color & Music, LLC) (Platforms: Windows, macOS/OSX) *'' MilkDrop'' (2001–2012, Ryan Geiss) reimplemented as ''projectM'' (Platforms: Multi-platform) *'' Music Animation Machine'' (1985–2013,

Stephen Malinowski Stephen Anthony Malinowski is an American composer, pianist, educator, software engineer, and inventor. He was born on August 6, 1953 in Santa Monica, California. He is best known for his musical animations and his computer program, the Mu ...

) visualizes

MIDI MIDI (; Musical Instrument Digital Interface) is a technical standard that describes a communications protocol, digital interface, and electrical connectors that connect a wide variety of electronic musical instruments, computers, an ...

, rather than waveforms. *''

Neon Neon is a chemical element with the symbol Ne and atomic number 10. It is a noble gas. Neon is a colorless, odorless, inert monatomic gas under standard conditions, with about two-thirds the density of air. It was discovered (along with krypt ...

'' (2004, Jeff Minter and Ivan Zorzin) (Platform: Xbox 360) *''

Psychedelia Psychedelia refers to the psychedelic subculture of the 1960s and the psychedelic experience. This includes psychedelic art, psychedelic music and style of dress during that era. This was primarily generated by people who used psychedelic dr ...

'' (1984, Jeff Minter), an early "light synthesizer", did not use audio input but was designed to create visualizations in accompaniment to music. *''

Virtual Light Machine The Virtual Light Machine (VLM) is a light synthesizer developed by Jeff Minter in 1990. It was installed into a number of electronics, including the Atari Jaguar CD and Nuon DVD players. The Virtual Light Machine is similar to what would later be ...

'' (1990, Jeff Minter) (Platform: Atari Jaguar)

List of media players supporting visualization

*'' AIMP'' (AIMP DevTeam) (Platform: Windows) *''

Apple Music Apple Music is a music, audio and video streaming service developed by Apple Inc. Users select music to stream to their device on-demand, or they can listen to existing playlists. The service also includes the Internet radio stations Apple ...

'' (2019, Apple) (Platforms: macOS, iOS & Android) *''

Foobar2000 foobar2000 (often abbreviated as fb2k or f2k) is a freeware audio player for Microsoft Windows, iOS and Android developed by Peter Pawłowski. It has a modular design, which provides user flexibility in configuration and customization. Stan ...

'' (Platform: Windows) *'' MediaPortal'' (OpenSource, Team MediaPortal) (Platform: Windows) *'' iTunes'' (2001, Apple) (Platforms: Mac OS X, Windows) *''

'' (Nullsoft/Radionomy) (Platforms: Windows) *''

Windows Media Player Windows Media Player (WMP) is the first media player and media library application that was developed by Microsoft for playing audio, video and viewing images on personal computers running the Microsoft Windows operating system, as well as ...

'' (Microsoft) (Platforms: Windows) *'' MediaMonkey'' (Ventis Media Inc.) (Platform: Windows) *''

Kodi KODI (1400 AM) is a radio station broadcasting a news/talk format. Licensed to Cody, Wyoming, United States, the station is currently owned by the Big Horn Radio Network, a division of Legend Communications of Wyoming, LLC, and features prog ...

(formerly XBMC)'' (Team XBMC) (Platform: Cross-Platform) *'' MusicBee'' (Steven Mayall) (Platforms: Windows) *'' K-Multimedia Player'' (Pandora.TV) (Platform: Windows) *''

Amarok Amarok may refer to: Music * Amarok (band), a Spanish progressive rock band * ''Amarok'' (Mike Oldfield album), 1990 * ''Amarok'' (Nargaroth album), 2000 * ''Amarok'', 2010 album by Francisco López (musician) Other uses * Amarok (wolf), in In ...

'' (Open Source, KDE) (Platform: Cross-platform) *''

Totem A totem (from oj, ᑑᑌᒼ, italics=no or ''doodem'') is a spirit being, sacred object, or symbol that serves as an emblem of a group of people, such as a family, clan, lineage (anthropology), lineage, or tribe, such as in the Anishinaabe clan ...

'' (Open Source, Gnome) (Platform: Linux) *'' Clementine'' (Open Source) (Platform: Cross-platform) *'' Audacious Media Player'' (Audacious Team) (Platforms: POSIX) *''

VLC media player VLC media player (previously the VideoLAN Client and commonly known as simply VLC) is a free and open-source, portable, cross-platform media player software and streaming media server developed by the VideoLAN project. VLC is available for d ...

'' ( VideoLAN Project) (Platforms: Cross-platform) *'' Xine player''

Notes

External links

Visual Music Archive
{{Visual music Audiovisual introductions in 1976 Visual effects Visual arts media Visual music Digital art