Stereo Object Tracking with Fusion of Texture, Color and Disparity Information

Olga Zoidi, Nikos Nikolaidis, Anastasios Tefas, Ioannis Pitas

Research output: Contribution to journalArticle (Academic Journal)peer-review

16 Citations (Scopus)
322 Downloads (Pure)

Abstract

A novel method for visual object tracking in stereo videos is proposed, which fuses an appearance based representation of the object based on Local Steering Kernel features and 2D color-disparity histogram information. The algorithm employs Kalman filtering for object position prediction and a sampling technique for selecting the candidate object regions of interest in the left and right channels. Disparity information is exploited, for matching corresponding regions in the left and right video frames. As tracking evolves, any significant changes in object appearance due to scale, rotation, or deformation are identified and embodied in the object model. The object appearance changes are identified simultaneously in the left and right channel video frames, ensuring correct 3D representation of the resulting bounding box in a 3D display monitor. The proposed framework performs stereo object tracking and it is suitable for application in 3D movies, 3D TV content and 3D video content captured by consuming stereo cameras. Experimental results proved the effectiveness of the proposed method in tracking objects under geometrical transformations, zooming and partial occlusion, as well as in tracking slowly deforming articulated 3D objects in stereo video.
Original languageEnglish
Pages (from-to)573-589
Number of pages17
JournalSignal Processing: Image Communication
Volume29
Issue number5
Early online date29 Mar 2014
DOIs
Publication statusPublished - May 2014

Keywords

  • Stereo object tracking
  • Color disparity histograms
  • Local steering kernels

Fingerprint Dive into the research topics of 'Stereo Object Tracking with Fusion of Texture, Color and Disparity Information'. Together they form a unique fingerprint.

Cite this