This paper presents a natural language-enabled virtual assistant (VA), named Max, developed to support flexible and scalable human–robot interactions (HRI) with industrial robots. Regardless of the numerous natural language interfaces already proposed for intuitive HRI on the industrial shop floor, most of those interfaces remain tightly bound with a specific robotic system. Besides, the lack of a natural and efficient human–robot communication protocol hinders the user experience. Therefore three key elements characterize the proposed framework. First, a Client–Server style architecture is introduced so Max can provide a centralized solution for managing and controlling various types of robots deployed on the shop floor. Second, inspired by human–human communication, two conversation strategies, lexical-semantic and general diversion strategies, are used to guide Max's response generation. These conversation strategies were embedded to improve the operator's engagement with the manufacturing tasks. Third, we fine-tuned the state-of-the-art (SOTA) pre-trained model, Bidirectional Encoder Representations from Transformers (BERT), to support a highly accurate prediction of requested intents from the operator and robot services. Multiple experiments were conducted using the latest iteration of our autonomous industrial mobile manipulator, “Little Helper (LH)”, to validate Max's performance in a real manufacturing environment.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A Speech-enabled Virtual Assistant for Efficient Human-Robot Interaction in Industrial Environments


    Beteiligte:
    LI, Chen (Autor:in) / Chrysostomou, Dimitrios (Autor:in) / Yang, Hongji (Autor:in)

    Erscheinungsdatum :

    2023-11-01


    Anmerkungen:

    LI , C , Chrysostomou , D & Yang , H 2023 , ' A Speech-enabled Virtual Assistant for Efficient Human-Robot Interaction in Industrial Environments ' , Journal of Systems and Software , vol. 205 , 111818 . https://doi.org/10.1016/j.jss.2023.111818



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Human Robot Interaction for Autonomous Systems in Industrial Environments

    Chadalavada, Ravi Teja | BASE | 2016

    Freier Zugriff

    A new emotional robot assistant that facilitates human interaction and persuasion

    Rincon, Jaime A. / Costa, Ângelo Gonçalo Araújo Silva / Novais, Paulo et al. | BASE | 2019

    Freier Zugriff


    Human-Robot Perception in Industrial Environments: A Survey

    Andrea Bonci / Pangcheng David Cen Cheng / Marina Indri et al. | BASE | 2021

    Freier Zugriff

    Human-Robot Perception in Industrial Environments: A Survey

    Bonci, Andrea / Cen Cheng, Pangcheng David / Indri, Marina et al. | BASE | 2021

    Freier Zugriff