Natural multimodal communication for human-robot collaboration

Simple item page
dc.contributor.authorMaurtua, Iñaki
dc.contributor.authorFernández, Izaskun
dc.contributor.authorTellaeche, Alberto
dc.contributor.authorKildal, Johan
dc.contributor.authorSusperregi, Loreto
dc.contributor.authorIbarguren, Aitor
dc.contributor.authorSierra, Basilio
dc.contributor.institutionROBOTICA_AUTOMA
dc.date.issued2017-07
dc.descriptionPublisher Copyright: © The Author(s) 2017.
dc.description.abstractThis article presents a semantic approach for multimodal interaction between humans and industrial robots to enhance the dependability and naturalness of the collaboration between them in real industrial settings. The fusion of several interaction mechanisms is particularly relevant in industrial applications in which adverse environmental conditions might affect the performance of vision-based interaction (e.g. poor or changing lighting) or voice-based interaction (e.g. environmental noise). Our approach relies on the recognition of speech and gestures for the processing of requests, dealing with information that can potentially be contradictory or complementary. For disambiguation, it uses semantic technologies that describe the robot characteristics and capabilities as well as the context of the scenario. Although the proposed approach is generic and applicable in different scenarios, this article explains in detail how it has been implemented in two real industrial cases in which a robot and a worker collaborate in assembly and deburring operations.en
dc.description.statusPeer reviewed
dc.format.extent12
dc.identifier.citationMaurtua , I , Fernández , I , Tellaeche , A , Kildal , J , Susperregi , L , Ibarguren , A & Sierra , B 2017 , ' Natural multimodal communication for human-robot collaboration ' , International Journal of Advanced Robotic Systems , vol. 14 , no. 4 , pp. 1-12 . https://doi.org/10.1177/1729881417716043
dc.identifier.doi10.1177/1729881417716043
dc.identifier.issn1729-8806
dc.identifier.urlhttp://www.scopus.com/inward/record.url?scp=85027442420&partnerID=8YFLogxK
dc.language.isoeng
dc.relation.ispartofInternational Journal of Advanced Robotic Systems
dc.relation.projectIDSeventh Framework Programme, FP7, 608849-637095
dc.rightsinfo:eu-repo/semantics/openAccess
dc.subject.keywordsCollaborative robots
dc.subject.keywordsFusion
dc.subject.keywordsMultimodal interaction
dc.subject.keywordsNatural communication
dc.subject.keywordsReasoning
dc.subject.keywordsSafe human-robot collaboration
dc.subject.keywordsSemantic web technologies
dc.subject.keywordsSoftware
dc.subject.keywordsComputer Science Applications
dc.subject.keywordsArtificial Intelligence
dc.subject.keywordsSDG 9 - Industry, Innovation, and Infrastructure
dc.titleNatural multimodal communication for human-robot collaborationen
dc.typejournal article
Files