Skip to content

A dual mode human-robot interface based on physiological signal capture in the aural cavity

Research output: Contribution to journalArticle

  • R Vaidyanathan
  • M Fargues
  • L Gupta
  • R Kurcan
  • D Lin
  • S Kota
  • RD Quinn
Original languageEnglish
Pages (from-to)1205 - 1223
Number of pages18
JournalInternational Journal of Robotics Research (IJRR)
DatePublished - Nov 2007


Robot teleoperation systems have been limited in their utility due to the need for operator motion, lack of portability and limitation to singular input modalities. In this article, the design and construction of a dual-mode human—machine interface system for robot teleoperation addressing all these issues is presented. The interface is capable of directing robotic devices in response to tongue movement and/or speech without insertion of any device in the vicinity of the oral cavity. The interface is centered on the unique properties of the human ear as an acoustic output device. Specifically, we present: (1) an analysis of the sensitivity of human ear canals as acoustic output device; (2) the design of a new sensor for monitoring airflow in the aural canal; (3) pattern recognition procedures for recognition of both speech and tongue movement by monitoring aural flow across several human test subjects; and (4) a conceptual design and simulation of the machine interface system. We believe this work will lay the foundation for a new generation of human machine interface systems for all manner of robotic applications.

Additional information

Publisher: Sage



View research connections

Related faculties, schools or groups