In human teams, visual and auditory cues are often used to communicate information about the task and/or environment that may not otherwise be directly observable. Analogously, robots that primarily rely on visual sensors cannot directly observe some attributes of objects that may be necessary for reference resolution or task execution. The experiments in this paper address natural language interaction in human-robot teams for tasks where multi-modal (e.g. visual, auditory, haptic, etc) observations are necessary for robust execution. We present a probabilistic model, verified through physical experiments, that allows robots to acquire knowledge about the latent aspects of the workspace through language and physical interaction in an efficient manner. The model’s effectiveness is demonstrated on a mobile and a stationary manipulator in real-world scenarios by following instructions under partial knowledge of object states in the environment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Real-Time Human-Robot Communication for Manipulation Tasks in Partially Observed Environments


    Additional title:

    Springer Proceedings in Advanced Robotics


    Contributors:

    Conference:

    International Symposium on Experimental Robotics ; 2018 ; Buenos Aires, Argentina November 05, 2018 - November 08, 2018



    Publication date :

    2020-01-23


    Size :

    13 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Real-Time Human-Robot Communication for Manipulation Tasks in Partially Observed Environments

    Arkin, Jacob / Paul, Rohan / Park, Daehyung et al. | TIBKAT | 2020


    Shared Control for Human-Robot Cooperative Manipulation Tasks

    Petrič, Tadej / Cevzar, Mišel / Babič, Jan | Springer Verlag | 2017


    Human-Robot Collaboration and Safety Management for Logistics and Manipulation Tasks

    Lim, Gi Hyun / Pedrosa, Eurico / Amaral, Filipe et al. | Springer Verlag | 2017



    Human-Multi-Robot Teleoperation for Cooperative Manipulation Tasks using Wearable Haptic Devices

    Music, Selma / Salvietti, Gionata / Dohmann, Pablo et al. | BASE | 2017

    Free access