Movie shot selection preserving narrative properties

Ioannis Mademlis, Anastasios Tefas, Nikos Nikolaidis, Ioannis Pitas

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

4 Citations (Scopus)
237 Downloads (Pure)

Abstract

Automatic shot selection is an important aspect of movie summarization that is helpful both to producers and to audiences, e.g., for market promotion or browsing purposes. However, most of the related research has focused on shot
selection based on low-level video content, which disregards semantic information, or on narrative properties extracted from text, which requires the movie script to be available. In this work, semantic shot selection based on the narrative prominence of movie characters in both the visual and the audio modalities is investigated, without the need for additional data such as a script.
The output is a movie summary that only contains video frames from selected movie shots. Selection is controlled by a userprovided shot retention parameter, that removes key-frames/keysegments from the skim based on actor face appearances and speech instances. This novel process (Multimodal Shot Pruning,
or MSP) is algebraically modelled as a multimodal matrix Column Subset Selection Problem, which is solved using an evolutionary computing approach.
Original languageEnglish
Title of host publication2016 IEEE 18th International Workshop on Multimedia Signal Processing (MMSP 2016)
Subtitle of host publicationProceedings of a meeting held 21-23 September 2016, Montreal, Quebec, Canada
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages352-356
Number of pages5
ISBN (Electronic)9781509037247
ISBN (Print)9781509037254
DOIs
Publication statusPublished - Feb 2017
Event 18th International Workshop on Multimedia Signal Processing: MMSP2016 - Montreal, Canada
Duration: 21 Sep 201623 Sep 2016

Publication series

NameProceedings of the International Workshop on Multimedia Signal Processing (MMSP)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
ISSN (Print)2163-3517
ISSN (Electronic)2473-3628

Conference

Conference 18th International Workshop on Multimedia Signal Processing
CountryCanada
CityMontreal
Period21/09/1623/09/16

Keywords

  • Video Summarization
  • Shot Selection
  • Column Sub-set Selection Problem

Fingerprint Dive into the research topics of 'Movie shot selection preserving narrative properties'. Together they form a unique fingerprint.

Cite this