Recognition and Reconstruction of Transparent Objects for Augmented Reality

Alan Torres Gomez, Walterio W Mayol-Cuevas

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

2 Citations (Scopus)
290 Downloads (Pure)

Abstract

Dealing with real transparent objects for AR is challenging due to their lack of texture and visual features as well as the drastic changes in appearance as the background, illumination and camera pose change. The few existing methods for glass object detection usually require a carefully controlled environment, specialized illumination hardware or ignore information from different viewpoints.

In this work, we explore the use of a learning approach for classifying transparent objects from multiple images with the aim of both discovering such objects and building a 3D reconstruction to support convincing augmentations. We extract, classify and group small image patches using a fast graph-based segmentation and employ a probabilistic formulation for aggregating spatially consistent glass regions. We demonstrate our approach via analysis of the performance of glass region detection and example 3D reconstructions that allow virtual objects to interact with them.
Original languageEnglish
Title of host publication2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014)
Subtitle of host publicationProceedings of a meeting held 10-12 September 2014, Munich, Germany
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages129-134
Number of pages6
ISBN (Electronic)9781479961849
ISBN (Print)9781479961856
DOIs
Publication statusPublished - Dec 2014

Keywords

  • Augmented Reality
  • Glass detection
  • 3D Reconstruction
  • Computer Vision

Fingerprint Dive into the research topics of 'Recognition and Reconstruction of Transparent Objects for Augmented Reality'. Together they form a unique fingerprint.

  • Cite this

    Torres Gomez, A., & Mayol-Cuevas, W. W. (2014). Recognition and Reconstruction of Transparent Objects for Augmented Reality. In 2014 IEEE International Symposium on Mixed and Augmented Reality (ISMAR 2014): Proceedings of a meeting held 10-12 September 2014, Munich, Germany (pp. 129-134). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/ISMAR.2014.6948418