Abstract: In gaze-based Human-Robot Interaction (HRI), it is important to determine human visual intention for interacting with robots. One typical HRI interaction scenario is that a human selects an object by gaze and a robotic manipulator will pick up the object. In this work, we propose an approach, GazeEMD, that can be used to detect whether a human is looking at an object for HRI application. We use Earth Mover’s Distance (EMD) to measure the similarity between the hypothetical gazes at objects and the actual gazes. Then, the similarity score is used to determine if the human visual intention is on the object. We compare our approach with a fixation-based method and HitScan with a run length in the scenario of selecting daily objects by gaze. Our experimental results indicate that the GazeEMD approach has higher accuracy and is more robust to noises than the other approaches. Hence, the users can lessen cognitive load by using our approach in the real-world HRI scenario.


    Access

    Download


    Export, share and cite



    Title :

    GazeEMD : detecting visual intention in gaze-based human-robot interaction


    Contributors:

    Publication date :

    2021-01-01


    Remarks:

    2218-6581 ; Robotics


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Visual intention classification by deep learning for gaze-based human-robot interaction

    Shi, Lei / Copot, Cosmin / Vanlanduit, Steve | BASE | 2020

    Free access

    Gaze detection in human-robot interaction

    Alanenpää, Madelene | BASE | 2020

    Free access


    Flight operation intention confirmation method based on continuous visual gaze

    Wang, Yawen / Yao, Yining / Wang, Changyuan et al. | SPIE | 2023


    Human-Robot Interaction Based on Gaze Gestures for the Drone Teleoperation

    Yu, Mingxin / Lin, Yingzi / Schmidt, David et al. | BASE | 2014

    Free access