RT Journal Article
T1 Natural multimodal communication for human-robot collaboration
A1 Maurtua, Iñaki
A1 Fernández, Izaskun
A1 Tellaeche, Alberto
A1 Kildal, Johan
A1 Susperregi, Loreto
A1 Ibarguren, Aitor
A1 Sierra, Basilio
AB This article presents a semantic approach for multimodal interaction between humans and industrial robots to enhance the dependability and naturalness of the collaboration between them in real industrial settings. The fusion of several interaction mechanisms is particularly relevant in industrial applications in which adverse environmental conditions might affect the performance of vision-based interaction (e.g. poor or changing lighting) or voice-based interaction (e.g. environmental noise). Our approach relies on the recognition of speech and gestures for the processing of requests, dealing with information that can potentially be contradictory or complementary. For disambiguation, it uses semantic technologies that describe the robot characteristics and capabilities as well as the context of the scenario. Although the proposed approach is generic and applicable in different scenarios, this article explains in detail how it has been implemented in two real industrial cases in which a robot and a worker collaborate in assembly and deburring operations.
SN 1729-8806
YR 2017
FD 2017-07
LA eng
NO Maurtua , I , Fernández , I , Tellaeche , A , Kildal , J , Susperregi , L , Ibarguren , A & Sierra , B 2017 , ' Natural multimodal communication for human-robot collaboration ' , International Journal of Advanced Robotic Systems , vol. 14 , no. 4 , pp. 1-12 . https://doi.org/10.1177/1729881417716043
NO Publisher Copyright: © The Author(s) 2017.
DS TECNALIA Publications
RD 2 sept 2024