Abstract
Molecular Music is an offshoot of a long-term collaborative project, the multi-award winning danceroom Spectroscopy (dS). dS has its roots in computational molecular dynamics, and was originally conceived to serve as an interactive platform for molecular simulation. It offers a multisensory immersive experience based on cutting-edge science facilitating an understanding of the principles of our microscopic world through direct experience rather than traditional academic learning. It consists of system of particles, simulated according to strict scientific principles; represented both visually and sonically, which can be interacted with through human movement. The project consists of a public installation, and also a contemporary dance piece, Hidden Fields, which is performed using the system. Hyde’s contribution to the project consists of the sonification (interactive systems and sound design) for the installation, and the composition of an interactive score for the dance piece.
Molecular Music is intended to facilitate further exploration of the audiovisual relationships at play in dS and Hidden Fields and to explore more deeply how to sonify vibrations on a micro scale (where sound does not, as such, exist). We have built some highly developed algorithms based on FFT analysis of molecular vibration data outside the range of human hearing to yield subharmonics on which sonic material can be based. We also have in place a sophisticated system whereby sound can control the particle system and the particle system can in turn control the sound. We are exploring how this combination can be used to make a novel kind of feedback loop, and a network of non-trivial audiovisual relationships whereby the influence of sound on image and vice versa is mediated via the medium of an advanced mixed quantum-classical model. Using these tools we can use dS as a highly evolved ‘visual music’ instrument.
The performance consists of a solo audiovisual performance of around 15 minutes duration. The paper outlines the algorithms at the heart of the dS system and their broader implications for Sci/Art visualisation/sonification and understanding, before moving on to examine how these algorithms have been adapted as an audiovisual instrument. The history of the project, including installations, dance performances and music-based collaborations, will be examined followed by a look to the future – in particular the development of dS as a large-scale permanent exhibit for ZKM in Karlsruhe to open in 2015.
Molecular Music is intended to facilitate further exploration of the audiovisual relationships at play in dS and Hidden Fields and to explore more deeply how to sonify vibrations on a micro scale (where sound does not, as such, exist). We have built some highly developed algorithms based on FFT analysis of molecular vibration data outside the range of human hearing to yield subharmonics on which sonic material can be based. We also have in place a sophisticated system whereby sound can control the particle system and the particle system can in turn control the sound. We are exploring how this combination can be used to make a novel kind of feedback loop, and a network of non-trivial audiovisual relationships whereby the influence of sound on image and vice versa is mediated via the medium of an advanced mixed quantum-classical model. Using these tools we can use dS as a highly evolved ‘visual music’ instrument.
The performance consists of a solo audiovisual performance of around 15 minutes duration. The paper outlines the algorithms at the heart of the dS system and their broader implications for Sci/Art visualisation/sonification and understanding, before moving on to examine how these algorithms have been adapted as an audiovisual instrument. The history of the project, including installations, dance performances and music-based collaborations, will be examined followed by a look to the future – in particular the development of dS as a large-scale permanent exhibit for ZKM in Karlsruhe to open in 2015.
| Original language | English |
|---|---|
| Title of host publication | GENERATIVE ART 2014 |
| Subtitle of host publication | e-book of the proceedings of XVII Generative Art conference (English language) at Tempio di Adriano and Angelica Library in Rome, organized by the Generative Design Lab of Politecnico di Milano University. |
| Place of Publication | Milan |
| Publisher | Domus Argenia |
| Pages | 169-187 |
| Number of pages | 20 |
| ISBN (Print) | 978-88-96610-30-5 |
| Publication status | Published - 19 Dec 2014 |
| Event | 17th Generative Art Conference - Rome, Italy Duration: 16 Dec 2014 → 19 Dec 2014 |
Conference
| Conference | 17th Generative Art Conference |
|---|---|
| Abbreviated title | GA2014 |
| Country/Territory | Italy |
| City | Rome |
| Period | 16/12/14 → 19/12/14 |