The new industrial settings are characterized by the presence of human and robots that work in close proximity, cooperating in performing the required job. Such a collaboration, however, requires to pay attention to many aspects. Firstly, it is crucial to enable a communication between this two actors that is natural and efficient. Secondly, the robot behavior must always be compliant with the safety regulations, ensuring always a safe collaboration. In this paper, we propose a framework that enables multi-channel communication between humans and robots by leveraging multimodal fusion of voice and gesture commands while always respecting safety regulations. The framework is validated through a comparative experiment, demonstrating that, thanks to multimodal communication, the robot can extract valuable information for performing the required task and additionally, with the safety layer, the robot can scale its speed to ensure the operator’s safety.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Safe Multimodal Communication in Human-Robot Collaboration


    Additional title:

    Springer Proceedings in Advanced Robotics



    Conference:

    International Workshop on Human-Friendly Robotics ; 2023 ; Munich, Germany September 20, 2023 - September 21, 2023



    Publication date :

    2024-03-10


    Size :

    13 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Multimodal Human-Robot Collaboration in Assembly

    Liu, Sichao | BASE | 2022

    Free access

    Toward Multimodal Human-Robot Cooperation and Collaboration

    Perzanowski, Dennis / Brock, Derek / Bugajska, Magdalena et al. | AIAA | 2004


    Multimodal sensor-based human-robot collaboration in assembly tasks

    Male, James / Al, Gorkem Anil / Shabani, Arya et al. | BASE | 2022

    Free access


    AIAA-2004-6366 Toward Multimodal Human-Robot Cooperation and Collaboration

    Perzanowski, D. / Brock, D. / Adams, W. et al. | British Library Conference Proceedings | 2004