Salem M, Kopp S, Wachsmuth I, Joublin F. Generating multi-modal robot behavior based on a virtual agent framework. In: Proceedings of the ICRA 2010 Workshop on Interactive Communication for Autonomous Intelligent Robots (ICAIR) . 2010: 23-25. ; One of the crucial steps in the attempt to build sociable, communicative humanoid robots is to endow them with expressive non-verbal behaviors along with speech. One such behavior is gesture, frequently used by human speakers to emphasize, supplement, or even complement what they express in speech. The generation of speech-accompanying robot gesture together with an evaluation of the effects of this multi-modal behavior is still largely unexplored. We present an approach to systematically address this issue by enabling the humanoid Honda robot to flexibly produce synthetic speech and expressive gesture from conceptual representations at runtime, while not being limited to a predefined repertoire of motor actions in this. Since this research challenge has already been tackled in various ways within the domain of virtual conversational agents, we build upon experiences gained with speech-gesture production models for virtual humans.


    Access

    Download


    Export, share and cite



    Title :

    Generating multi-modal robot behavior based on a virtual agent framework


    Contributors:

    Publication date :

    2010-01-01


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Keywords :

    Classification :

    DDC:    006 / 629




    Multi-modal robot

    FAN MENGLONG / LIANG BIN / LIU HOUDE et al. | European Patent Office | 2024

    Free access

    Multi-modal operation robot

    GUO TINGTING / XIAO HUI / LU SHUAI et al. | European Patent Office | 2024

    Free access

    Synchronized Multi-Modal Robot

    CHUNG SOON-JO | European Patent Office | 2021

    Free access

    MULTI-MODAL MULTI-AGENT TRAJECTORY PREDICTION

    SUN PEI / ZHAO HANG / MCCAULEY ALEXANDER et al. | European Patent Office | 2022

    Free access

    Multi-modal multi-agent trajectory prediction

    SUN PEI / ZHAO HANG / MCCAULEY ALEXANDER et al. | European Patent Office | 2024

    Free access