Skip to content

Automated Composition of Picture-Synched Music Soundtracks for Movies

Research output: Chapter in Book/Report/Conference proceedingConference contribution

Original languageEnglish
Title of host publicationCVMP'19: ACM European Conference on Visual Media Production.
Subtitle of host publication16th ACM SIGGRAPH European Conference on Visual Media Production
EditorsWill Smith, Neill Campbell, Christian Richardt
Publisher or commissioning bodyAssociation for Computing Machinery (ACM)
Number of pages10
ISBN (Print)978-1-4503-7003-5
DateAccepted/In press - 15 Oct 2019
DatePublished (current) - 17 Dec 2019
EventACM SIGGRAPH European Conference on Visual Media Production - London, United Kingdom
Duration: 17 Dec 201918 Dec 2019
Conference number: 16

Publication series

NameProceedings - CVMP 2019: 16th ACM SIGGRAPH European Conference on Visual Media Production


ConferenceACM SIGGRAPH European Conference on Visual Media Production
Abbreviated titleCVMP2019
CountryUnited Kingdom
Internet address


We describe the implementation of and early results from a system that automatically composes picture-synched musical soundtracks for videos and movies. We use the phrase _picture-synched_ to mean that the structure of the automatically composed music is determined by visual events in the input movie, i.e. the final music is synchronised to visual events and features such as cut transitions or within-shot key-frame events. Our system combines automated video analysis and computer-generated music-composition techniques to create unique soundtracks in response to the video input, and can be thought of as an initial step in creating a computerised replacement for a human composer writing music to fit the picture-locked edit of a movie. Working only from the video information in the movie, key features are extracted from the input video, using video analysis techniques, which are then fed into a machine-learning-based music generation tool, to compose a piece of music
from scratch. The resulting soundtrack is tied to video features, such as scene
transition markers and scene-level energy values, and is unique to the input video. Although the system we describe here is only a preliminary proof-of-concept, user evaluations of the output of the system have been positive.

    Research areas

  • Automated music composition, Machine learning, Video soundtracks


ACM SIGGRAPH European Conference on Visual Media Production

Abbreviated titleCVMP2019
Conference number16
Duration17 Dec 201918 Dec 2019
CountryUnited Kingdom
Web address (URL)
Degree of recognitionInternational event

Event: Conference

Download statistics

No data available



  • Full-text PDF (accepted author manuscript)

    Rights statement: This is the author accepted manuscript (AAM). The final published version (version of record) is available online via ACM at Please refer to any applicable terms of use of the publishe

    Accepted author manuscript, 842 KB, PDF document


View research connections

Related faculties, schools or groups