Stereoscopic video shot clustering into semantic concepts based on visual and disparity information

Konstantinos Papachristou; Anastasios Tefas; Nikos Nikolaidis; Ioannis Pitas

doi:10.1109/ICIP.2014.7026107

Stereoscopic video shot clustering into semantic concepts based on visual and disparity information

Konstantinos Papachristou, Anastasios Tefas, Nikos Nikolaidis, Ioannis Pitas

Department of Electrical & Electronic Engineering

Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

2 Citations (Scopus)

331 Downloads (Pure)

Abstract

In this paper, we propose a framework for clustering shots from stereoscopic videos into clusters that correspond to semantic concepts exploiting visual and disparity information. Various color, disparity and texture descriptors are applied to shot key frames for obtaining low-level representations. Self Organizing Maps are subsequently employed upon various combinations of these representations in order to determine a lattice of representative semantic concepts. Experimental results on performances and football stereoscopic videos show that the use of disparity information leads to better clustering compared to using visual information only.

Original language	English
Title of host publication	2014 IEEE International Conference on Image Processing (ICIP 2014)
Subtitle of host publication	Proceedings of a meeting held 27-30 October 2014, Paris, France
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
Pages	5472-5476
Number of pages	5
ISBN (Electronic)	9781479957514
ISBN (Print)	9781479957521
DOIs	https://doi.org/10.1109/ICIP.2014.7026107
Publication status	Published - Mar 2015
Event	IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2014) - Reims, France Duration: 21 Sep 2014 → 24 Sep 2014

Publication series

Name	Proceedings of IEEE International Conference on Image Processing (ICIP)
Publisher	Institute of Electrical and Electronics Engineers (IEEE)
ISSN (Print)	1522-4880

Conference

Conference	IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2014)
Country	France
City	Reims
Period	21/09/14 → 24/09/14

Keywords

Semantic concepts
stereoscopic video
disparity
shot clustering
Self Organizing Map

Access to Document

10.1109/ICIP.2014.7026107

Ioannis Pitas - Stereoscopic video shot clustering into semantic concepts based on visual and disparity information - 2014
This is the author accepted manuscript (AAM). The final published version (version of record) is available online via IEEE at http://ieeexplore.ieee.org/xpls/abs_all.jsp?arnumber=7026107&tag=1. Please refer to any applicable terms of use of the publisher.
Accepted author manuscript, 5.93 MB

Fingerprint Dive into the research topics of 'Stereoscopic video shot clustering into semantic concepts based on visual and disparity information'. Together they form a unique fingerprint.

Cite this

Papachristou, K., Tefas, A., Nikolaidis, N., & Pitas, I. (2015). Stereoscopic video shot clustering into semantic concepts based on visual and disparity information. In 2014 IEEE International Conference on Image Processing (ICIP 2014): Proceedings of a meeting held 27-30 October 2014, Paris, France (pp. 5472-5476). (Proceedings of IEEE International Conference on Image Processing (ICIP)). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/ICIP.2014.7026107

Papachristou, Konstantinos ; Tefas, Anastasios ; Nikolaidis, Nikos ; Pitas, Ioannis. / Stereoscopic video shot clustering into semantic concepts based on visual and disparity information. 2014 IEEE International Conference on Image Processing (ICIP 2014): Proceedings of a meeting held 27-30 October 2014, Paris, France. Institute of Electrical and Electronics Engineers (IEEE), 2015. pp. 5472-5476 (Proceedings of IEEE International Conference on Image Processing (ICIP)).

@inproceedings{9f628456f30740538162148a30406a11,

title = "Stereoscopic video shot clustering into semantic concepts based on visual and disparity information",

abstract = "In this paper, we propose a framework for clustering shots from stereoscopic videos into clusters that correspond to semantic concepts exploiting visual and disparity information. Various color, disparity and texture descriptors are applied to shot key frames for obtaining low-level representations. Self Organizing Maps are subsequently employed upon various combinations of these representations in order to determine a lattice of representative semantic concepts. Experimental results on performances and football stereoscopic videos show that the use of disparity information leads to better clustering compared to using visual information only.",

keywords = "Semantic concepts, stereoscopic video, disparity, shot clustering, Self Organizing Map",

author = "Konstantinos Papachristou and Anastasios Tefas and Nikos Nikolaidis and Ioannis Pitas",

year = "2015",

month = mar,

doi = "10.1109/ICIP.2014.7026107",

language = "English",

isbn = "9781479957521",

series = "Proceedings of IEEE International Conference on Image Processing (ICIP)",

publisher = "Institute of Electrical and Electronics Engineers (IEEE)",

pages = "5472--5476",

booktitle = "2014 IEEE International Conference on Image Processing (ICIP 2014)",

address = "United States",

note = "IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2014) ; Conference date: 21-09-2014 Through 24-09-2014",

}

Papachristou, K, Tefas, A, Nikolaidis, N & Pitas, I 2015, Stereoscopic video shot clustering into semantic concepts based on visual and disparity information. in 2014 IEEE International Conference on Image Processing (ICIP 2014): Proceedings of a meeting held 27-30 October 2014, Paris, France. Proceedings of IEEE International Conference on Image Processing (ICIP), Institute of Electrical and Electronics Engineers (IEEE), pp. 5472-5476, IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2014), Reims, France, 21/09/14. https://doi.org/10.1109/ICIP.2014.7026107

Stereoscopic video shot clustering into semantic concepts based on visual and disparity information. / Papachristou, Konstantinos; Tefas, Anastasios; Nikolaidis, Nikos; Pitas, Ioannis.

2014 IEEE International Conference on Image Processing (ICIP 2014): Proceedings of a meeting held 27-30 October 2014, Paris, France. Institute of Electrical and Electronics Engineers (IEEE), 2015. p. 5472-5476 (Proceedings of IEEE International Conference on Image Processing (ICIP)).

Research output: Chapter in Book/Report/Conference proceeding › Conference Contribution (Conference Proceeding)

TY - GEN

T1 - Stereoscopic video shot clustering into semantic concepts based on visual and disparity information

AU - Papachristou, Konstantinos

AU - Tefas, Anastasios

AU - Nikolaidis, Nikos

AU - Pitas, Ioannis

PY - 2015/3

Y1 - 2015/3

N2 - In this paper, we propose a framework for clustering shots from stereoscopic videos into clusters that correspond to semantic concepts exploiting visual and disparity information. Various color, disparity and texture descriptors are applied to shot key frames for obtaining low-level representations. Self Organizing Maps are subsequently employed upon various combinations of these representations in order to determine a lattice of representative semantic concepts. Experimental results on performances and football stereoscopic videos show that the use of disparity information leads to better clustering compared to using visual information only.

AB - In this paper, we propose a framework for clustering shots from stereoscopic videos into clusters that correspond to semantic concepts exploiting visual and disparity information. Various color, disparity and texture descriptors are applied to shot key frames for obtaining low-level representations. Self Organizing Maps are subsequently employed upon various combinations of these representations in order to determine a lattice of representative semantic concepts. Experimental results on performances and football stereoscopic videos show that the use of disparity information leads to better clustering compared to using visual information only.

KW - Semantic concepts

KW - stereoscopic video

KW - disparity

KW - shot clustering

KW - Self Organizing Map

U2 - 10.1109/ICIP.2014.7026107

DO - 10.1109/ICIP.2014.7026107

M3 - Conference Contribution (Conference Proceeding)

SN - 9781479957521

T3 - Proceedings of IEEE International Conference on Image Processing (ICIP)

SP - 5472

EP - 5476

BT - 2014 IEEE International Conference on Image Processing (ICIP 2014)

PB - Institute of Electrical and Electronics Engineers (IEEE)

T2 - IEEE International Workshop on Machine Learning for Signal Processing (MLSP 2014)

Y2 - 21 September 2014 through 24 September 2014

ER -

Papachristou K, Tefas A, Nikolaidis N, Pitas I. Stereoscopic video shot clustering into semantic concepts based on visual and disparity information. In 2014 IEEE International Conference on Image Processing (ICIP 2014): Proceedings of a meeting held 27-30 October 2014, Paris, France. Institute of Electrical and Electronics Engineers (IEEE). 2015. p. 5472-5476. (Proceedings of IEEE International Conference on Image Processing (ICIP)). https://doi.org/10.1109/ICIP.2014.7026107