Reactable003
   HOME

TheInfoList



OR:

The Reactable is an
electronic musical instrument An electronic musical instrument or electrophone is a musical instrument that produces sound using electronics, electronic circuitry. Such an instrument sounds by outputting an electrical, electronic or digital audio signal that ultimately is ...
with a tabletop
tangible user interface A tangible user interface (TUI) is a user interface in which a person interacts with digital information through the physical environment. The initial name was Graspable User Interface, which is no longer used. The purpose of TUI development ...
that was developed within the Music Technology Group at the
Universitat Pompeu Fabra Pompeu Fabra University (, ; ) is a public university located in the city of Barcelona, Catalonia in Spain. Established in 1990 by the Autonomous Government of Catalonia and named after Pompeu Fabra, it is known for its competitiveness in resea ...
in
Barcelona Barcelona ( ; ; ) is a city on the northeastern coast of Spain. It is the capital and largest city of the autonomous community of Catalonia, as well as the second-most populous municipality of Spain. With a population of 1.6 million within c ...
,
Spain Spain, or the Kingdom of Spain, is a country in Southern Europe, Southern and Western Europe with territories in North Africa. Featuring the Punta de Tarifa, southernmost point of continental Europe, it is the largest country in Southern Eur ...
by Sergi Jordà, Marcos Alonso, Martin Kaltenbrunner and Günter Geiger. In late 2010, a mobile version of the Reactable was released for iOS.


Basic operation

The Reactable is a round translucent table, used in a darkened room, and appears as a
backlit A backlight is a form of illumination used in liquid-crystal displays (LCDs) that provides light from the back or side of a display panel. LCDs do not produce light on their own, so they require illumination—either from ambient light or a de ...
display. By placing blocks called ''tangibles'' on the table, and interfacing with the visual display via the tangibles or fingertips, a virtual
modular synthesizer Modular synthesizers are synthesizers composed of separate modules for different functions. The modules can be connected together by the user to create a patch. The outputs from the modules may include audio signals, analog control voltages, ...
is operated, creating music or sound effects.


Tangibles

There are various types of tangibles representing different modules of an analog synthesizer. Audio frequency VCOs, LFOs, VCFs, and sequencers are some of the commonly used tangibles. There are also tangibles that affect other modules: one called ''radar'' is a periodic trigger, and another called ''tonalizer'' limits a VCO to the notes of a
musical scale In music theory, a scale is "any consecutive series of notes that form a progression between one note and its octave", typically by order of pitch or fundamental frequency. The word "scale" originates from the Latin ''scala'', which literal ...
.


Using tangibles with the display

The table itself is the display. As a tangible is placed on the table, various animated symbols appear, such as waveforms, circles, circular grids, or sweeping lines. Some symbols merely show what the particular tangible is doing, others can be used by fingertip to control the respective module.


Example of operation

If a VCO tangible is placed on the table, a VCO module is added to the virtual synthesizer. In the display, a waveform will appear between the tangible and the "output" (a bright spot at the center of the table), and a circle appears around the tangible which allows fingertip control of the amplitude of the waveform. Additionally, in this example the tangible can be rotated by hand to change the frequency. Placing a filter tangible between the VCO and the output causes the VCO's waveform to connect to the filter, and the filter waveform to connect to the output. If an LFO tangible is placed near the VCO, a waveform will then appear connecting those two, and the LFO will modulate the VCO.


Structure

The main user interface consists of a translucent table. Underneath the table is a
voice recorder A dictation machine is a sound recording device most commonly used to record speech for playback or to be typed into print. It includes digital voice recorders and tape recorder. The name "Dictaphone" is a trademark of the American Graphophone ...
, aimed at the underside of the table and inputting video to a
personal computer A personal computer, commonly referred to as PC or computer, is a computer designed for individual use. It is typically used for tasks such as Word processor, word processing, web browser, internet browsing, email, multimedia playback, and PC ...
. There is also a
video projector A video projector is an image projector that receives a video signal and projects the corresponding image onto a projection screen using a lens system. Video projectors use a very bright ultra-high-performance lamp (a special mercury arc l ...
under the table, also connected to the computer, projecting video onto the underside of the table top that can be seen from the upper side as well. There is an audio engine based on
Pure Data Pure Data (Pd) is a visual programming language developed by Miller Puckette in the 1990s for creating interactive computer music and multimedia works. While Puckette is the main author of the program, Pd is an open-source software, open-source ...
and
SuperCollider SuperCollider is an environment and audio programming language released originally in 1996 by James McCartney for real-time audio synthesis and algorithmic composition.J. McCartneySuperCollider: A new real time synthesis language in Proc. Int ...
Placed onto the table are the tangibles that have '' fiducials'' attached to their underside which are seen through the table by the camera. The fiducials are printed black-and-white images, consisting of circles and dots in varying patterns, optimized for use by reacTIVision. reacTIVision then uses the fiducials to understand the function of a particular tangible. Most of the tangibles are flat, with one fiducial on the underside. Some other tangibles are cubes, with fiducials attached to several sides, allowing those tangibles to serve multiple functions. Currently, there are two versions of the Reactable, Reactable Live! and the Reactable experience. Reactable Live is a smaller, more portable version designed for professional musicians. The Reactable experience is more like the original Reactable, and suited for installations in public spaces.


reacTIVision

The live video stream received from a digital video camera is processed by the
open-source Open source is source code that is made freely available for possible modification and redistribution. Products include permission to use and view the source code, design documents, or content of the product. The open source model is a decentrali ...
computer vision Computer vision tasks include methods for image sensor, acquiring, Image processing, processing, Image analysis, analyzing, and understanding digital images, and extraction of high-dimensional data from the real world in order to produce numerical ...
software called reacTIVision, originally developed by Martin Kaltenbrunner and Ross Bencina for the Reactable project. reacTIVision detects cartesian and rotational placement of fiducials on the table surface, then emits the specially designed
Open Sound Control Open Sound Control (OSC) is a protocol for networking sound synthesizers, computers, and other multimedia devices for purposes such as musical performance or show control. OSC's advantages include interoperability, accuracy, flexibility and en ...
based
network protocol A communication protocol is a system of rules that allows two or more entities of a communications system to transmit information via any variation of a physical quantity. The protocol defines the rules, syntax, semantics, and synchronization of ...
called
TUIO A tangible user interface (TUI) is a user interface in which a person interacts with digital information through the physical environment. The initial name was Graspable User Interface, which is no longer used. The purpose of TUI development ...
, which communicates to the actual synthesizer and visualization software that outputs to the video projector. reacTIVision is also capable of multi-touch fingertip tracking.


Presentations

The Reactable has been presented and performed at various festivals and conferences such as
Ars Electronica Ars Electronica Linz GmbH is an Austrian cultural, educational and scientific institute active in the field of new media art, founded in Linz in 1979. It is based at the Ars Electronica Center (AEC), which houses the Museum of the Future, in t ...
,
Sónar Sónar is a festival dedicated to music, creativity and technology, founded in Barcelona in 1994 by Ricard Robles, Enric Palau, and Sergi Caballero. The festival has been divided into two parts since its inception: Sónar by Day and Sónar b ...
,
NIME New Interfaces for Musical Expression, also known as NIME, is an international conference dedicated to scientific research on the development of new technologies and their role in musical expression and artistic performance. History The confer ...
and
SIGGRAPH SIGGRAPH (Special Interest Group on Computer Graphics and Interactive Techniques) is an annual conference centered around computer graphics organized by ACM, starting in 1974 in Boulder, CO. The main conference has always been held in North ...
. Over the years, the Reactable team has showcased more than 150 presentations and concerts in more than 30 countries around the world. Icelandic singer
Björk Björk Guðmundsdóttir ( , ; born 21 November 1965), known mononymously as Björk, is an Icelandic singer, songwriter, composer, record producer, and actress. Noted for her distinct voice, three-octave vocal range, and eccentric public per ...
is perhaps the first musician outside of the select presentations and demonstrations to use a Reactable in live performance. Björk's 2007 world tour supporting her 2007 release '' Volta'' used the instrument in several songs including "
Declare Independence "Declare Independence" is a song written and recorded by Icelandic singer Björk. It was released on 1 January 2008 through One Little Indian as the third single from her sixth studio album, '' Volta''. Björk's dedication of the song to variou ...
"; Björk's live inaugural use of the instrument took place at the
Coachella Valley Music and Arts Festival Coachella (officially called the Coachella Valley Music and Arts Festival and sometimes known as Coachella Festival) is an annual music and arts festival held at the Empire Polo Club in Indio, California, in the Coachella Valley in the Colora ...
on April 27, 2007. Recently splitting into two models, the Reactable Experience is on display in many exhibitions. Some of these include: INTECH,
Discovery World (museum) Discovery World is a science and technology museum in Milwaukee, Milwaukee, Wisconsin. Discovery World is a 501(c)(3) organization, 501(c)(3) non-profit organization that does not receive any public funding. History Founded by Robert Powrie H ...
, Museum of Science and Industry, Sub Mix Pro, ZKM, and Game Science Center Berlin. During the
2010 Winter Olympics The 2010 Winter Olympics, officially known as the XXI Olympic Winter Games () and also known as Vancouver 2010 (), were an international winter multi-sport event held from February 12 to 28, 2010 in Vancouver, British Columbia, Canada, with ...
in Vancouver, the Reactable was featured at the
CODE In communications and information processing, code is a system of rules to convert information—such as a letter, word, sound, image, or gesture—into another form, sometimes shortened or secret, for communication through a communicati ...
festival. Throughout February, this event featured interactive media paired with sports and music. In March 2010, a Reactable was installed at
Discovery Place Discovery Place Science is a science and technology museum, located in Uptown, Charlotte, North Carolina. Discovery Place Science operates The Charlotte Observer IMAX Dome Theater, also referred to as an OMNIMAX theater. It is the largest IMAX ...
in Charlotte, North Carolina. as part of the 'Think it up' exhibition which opened to the public on May 1, 2010 From July 2, 2010, until October 1, 2010, a Reactable Experience was on display in the
Science Gallery Science Gallery is an international group of public science centres, developed from a concept by a group connected to Trinity College Dublin in Ireland. The first Science Gallery was opened in 2008 and housed in the Naughton Institute at Trinity ...
in Trinity College Dublin, Ireland, as part of their 'BioRhythm' exhibition. There is Reactable at the Centre des sciences de Montréal in Montreal, Canada. In 2011 the band
Nero Nero Claudius Caesar Augustus Germanicus ( ; born Lucius Domitius Ahenobarbus; 15 December AD 37 – 9 June AD 68) was a Roman emperor and the final emperor of the Julio-Claudian dynasty, reigning from AD 54 until his ...
featured a Reactable in the music video of their single "Promises". From March 2011 a Reactable is on display in
Copernicus Science Centre Copernicus Science Centre () is a science museum standing on the bank of the Vistula River in Warsaw, Poland. It contains over 450 interactive exhibits that enable visitors to single-handedly carry out experiments and discover the laws of sci ...
, Warsaw, Poland. It is a part of "Re:Generation" exhibition and is available for use by visitors. British band
Coldplay Coldplay are a British Rock music, rock band formed in London in 1997. They consist of vocalist and pianist Chris Martin, guitarist Jonny Buckland, bassist Guy Berryman, drummer and percussionist Will Champion, and manager Phil Harvey (band m ...
used a Reactable during their performance of their song "
Midnight Midnight is the transition time from one day to the next – the moment when the date changes, on the local official clock time for any particular jurisdiction. By clock time, midnight is the opposite of noon, differing from it by 12 hours. ...
" during
iTunes Festival The Apple Music Festival (formerly known as the iTunes Festival) was a concert series held by Apple, Inc. and inaugurated in 2007. Free tickets were given to Apple Music, iTunes and DICE users who lived in the United Kingdom, through localized ...
at
SXSW South by Southwest (SXSW) is an annual conglomeration of parallel film, interactive media, and music festivals and Convention (meeting), conferences organized jointly that take place in mid-March in Austin, Texas. It began in 1987 and has conti ...
on March 11, 2014.


Awards

The Reactable received much attention from bloggers and was featured in major TV shows and popular magazines. Rolling Stone Magazine claimed that the Reactable was the hot instrument of 2007. The device has also received several awards including Prix Ars Electronica Golden Nica for Digital Musics, the MIDEM Hottest Music Biz Start-Up Award, and two D&AD Yellow Pencil Awards in 2008.


See also

*
Audiocubes AudioCubes are a collection of wireless intelligent light-emitting objects, capable of detecting each other's location, orientation, and user gestures. They were created by Bert Schiettecatte as electronic musical instruments for use by musici ...
*
Multi-touch In computing, multi-touch is technology that enables a surface (a touchpad or touchscreen) to recognize the presence of more than one somatosensory system, point of contact with the surface at the same time. The origins of multitouch began at CE ...
*
Tenori-on The Yamaha Tenori-on is an electronic musical instrument designed and created by the Japanese artist Toshio Iwai and Yu Nishibori of the Music and Human Interface Group at the Yamaha (manufacturer), Yamaha Center for Advanced Sound Technology. ...
*
Turntables A phonograph, later called a gramophone, and since the 1940s a record player, or more recently a turntable, is a device for the mechanical and analogue reproduction of sound. The sound vibration Waveform, waveforms are recorded as correspond ...


References


External links


Reactable website

Music Technology Group
* View Demo

* View Demo

{{Authority control Electronic musical instruments Experimental musical instruments Surface computing User interfaces