Richter V, Carlmeyer B, Lier F, et al. Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees. In: Proceedings of the Fourth International Conference on Human-agent Interaction . Proceedings of the Fourth International Conference on Human-agent Interaction. Singapore: ACM Digital Library; 2016. ; In this paper we present our humanoid robot “Meka”, partici- pating in a multi party human robot dialogue scenario. Active arbitration of the robot's attention based-on multi-modal stim- uli is utilised to attain persons which are outside of the robots field of view. We investigate the impact of this attention management and an addressee recognition on the robot's capability to distinguish utterances directed at it from communication between humans. Based on the results of a user study, we show that mutual gaze at the end of an utterance, as a means of yielding a turn, is a substantial cue for addressee recognition. Verification of a speaker through the detection of lip movements can be used to further increase precision. Further- more, we show that even a rather simplistic fusion of gaze and lip movement cues allows a considerable enhancement in addressee estimation, and can be altered to adapt to the requirements of a particular scenario.


    Access

    Download


    Export, share and cite



    Title :

    Are you talking to me? Improving the robustness of dialogue systems in a multi party HRI scenario by incorporating gaze direction and lip movement of attendees



    Publication date :

    2016-01-01


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Keywords :

    Classification :

    DDC:    006 / 629




    Gaze direction detection device, and gaze direction detection method

    TAKEDA HIDETOSHI / KIMURA MASAYUKI | European Patent Office | 2017

    Free access

    GAZE DIRECTION DETERMINATION APPARATUS

    OHRENSTEIN ROBERT | European Patent Office | 2023

    Free access

    GAZE DIRECTION DETERMINATION APPARATUS

    OHRENSTEIN ROBERT | European Patent Office | 2023

    Free access


    APPARATUS FOR DETECTING OF DRIVER GAZE DIRECTION

    European Patent Office | 2020

    Free access