Abstract
Co-verbal gestures are an important part of human
communication, improving its efficiency for information
conveyance. A key component of such improvement is the
observer’s ability to integrate information from the two communication
channels, speech and gesture. Whether such integration
also occurs when the multi-modal communication information
is produced by a humanoid robot, and whether it is as efficient
as for a human communicator, is an open question. Here, we
present an experiment which, using a fully within subjects
design, shows that for a range of iconic gestures, speech and
gesture integration occurs with similar efficiency for human
and for robot communicators. The gestures for this study were
produced on an Aldebaran Robotics NAO robot platform with
a Kinect based tele-operation system. We also show that our
system is able to produce a range of iconic gestures that
are understood by participants in unimodal (gesture only)
communication, as well as being efficiently integrated with
speech. Hence, we demonstrate the utility of iconic gestures
for robotic communicators.
communication, improving its efficiency for information
conveyance. A key component of such improvement is the
observer’s ability to integrate information from the two communication
channels, speech and gesture. Whether such integration
also occurs when the multi-modal communication information
is produced by a humanoid robot, and whether it is as efficient
as for a human communicator, is an open question. Here, we
present an experiment which, using a fully within subjects
design, shows that for a range of iconic gestures, speech and
gesture integration occurs with similar efficiency for human
and for robot communicators. The gestures for this study were
produced on an Aldebaran Robotics NAO robot platform with
a Kinect based tele-operation system. We also show that our
system is able to produce a range of iconic gestures that
are understood by participants in unimodal (gesture only)
communication, as well as being efficiently integrated with
speech. Hence, we demonstrate the utility of iconic gestures
for robotic communicators.
| Original language | English |
|---|---|
| Publication status | Published - 2015 |
| Event | 2015 IEEE International Conference on Robotics and Automation - Washington, Seattle, United States Duration: 26 May 2015 → 30 May 2015 |
Conference
| Conference | 2015 IEEE International Conference on Robotics and Automation |
|---|---|
| Country/Territory | United States |
| City | Seattle |
| Period | 26/05/15 → 30/05/15 |
Research Groups and Themes
- Visual Perception
- Cognitive Science