Bodily aware soft robots: integration of proprioceptive and exteroceptive sensors

Research output: Chapter in Book/Report/Conference proceedingConference Contribution (Conference Proceeding)

4 Citations (Scopus)
261 Downloads (Pure)

Abstract

Being aware of our body has great importance in our everyday life. It helps us to complete difficult tasks, such as movement in a dark room or grasping a complex object. These skills are important for robots as well, however, robotic bodily awareness is still an open question, and the nonlinearity of soft robots adds even more complexity. In this paper, we address this problem and present a novel method to implement bodily awareness into a real soft robot by the integration of its exteroceptive and proprioceptive sensors. We use an octopus-inspired arm as an example where the proprioceptive representation is approximated by four bend sensors integrated into the soft body, while a camera records the movement of the arm capturing its exteroceptive representation. The internal sensory signals are mapped to the visual information using a combination of a stacked convolutional autoencoder (CAE) and a recurrent neural network (RNN). As a result, the soft robot can learn to estimate and, therefore, to imagine its motion even when its visual sensor is not available.
Original languageEnglish
Title of host publication2018 IEEE International Conference on Robotics and Automation (ICRA 2018)
PublisherInstitute of Electrical and Electronics Engineers (IEEE)
Pages2448-2453
Number of pages6
ISBN (Electronic)9781538630815
ISBN (Print)9781538630822
DOIs
Publication statusPublished - Nov 2018
Event2018 IEEE International Conference on Robotics and Automation (ICRA) - Brisbane, Australia
Duration: 21 May 201825 May 2018

Publication series

Name
ISSN (Print)1050-4729

Conference

Conference2018 IEEE International Conference on Robotics and Automation (ICRA)
Abbreviated titleICRA
CountryAustralia
CityBrisbane
Period21/05/1825/05/18

Structured keywords

  • Tactile Action Perception

Keywords

  • Convolution
  • Soft robotics
  • Robot sensing systems
  • Visualization
  • Recurrent neural networks

Fingerprint Dive into the research topics of 'Bodily aware soft robots: integration of proprioceptive and exteroceptive sensors'. Together they form a unique fingerprint.

  • Cite this

    Soter, G., Conn, A., Hauser, H., & Rossiter, J. (2018). Bodily aware soft robots: integration of proprioceptive and exteroceptive sensors. In 2018 IEEE International Conference on Robotics and Automation (ICRA 2018) (pp. 2448-2453). Institute of Electrical and Electronics Engineers (IEEE). https://doi.org/10.1109/ICRA.2018.8463169