In human teams, visual and auditory cues are often used to communicate information about the task and/or environment that may not otherwise be directly observable. Analogously, robots that primarily rely on visual sensors cannot directly observe some attributes of objects that may be necessary for reference resolution or task execution. The experiments in this paper address natural language interaction in human-robot teams for tasks where multi-modal (e.g. visual, auditory, haptic, etc) observations are necessary for robust execution. We present a probabilistic model, verified through physical experiments, that allows robots to acquire knowledge about the latent aspects of the workspace through language and physical interaction in an efficient manner. The model’s effectiveness is demonstrated on a mobile and a stationary manipulator in real-world scenarios by following instructions under partial knowledge of object states in the environment.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Real-Time Human-Robot Communication for Manipulation Tasks in Partially Observed Environments


    Weitere Titelangaben:

    Springer Proceedings in Advanced Robotics


    Beteiligte:
    Xiao, Jing (Herausgeber:in) / Kröger, Torsten (Herausgeber:in) / Khatib, Oussama (Herausgeber:in) / Arkin, Jacob (Autor:in) / Paul, Rohan (Autor:in) / Park, Daehyung (Autor:in) / Roy, Subhro (Autor:in) / Roy, Nicholas (Autor:in) / Howard, Thomas M. (Autor:in)

    Kongress:

    International Symposium on Experimental Robotics ; 2018 ; Buenos Aires, Argentina November 05, 2018 - November 08, 2018



    Erscheinungsdatum :

    2020-01-23


    Format / Umfang :

    13 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Real-Time Human-Robot Communication for Manipulation Tasks in Partially Observed Environments

    Arkin, Jacob / Paul, Rohan / Park, Daehyung et al. | TIBKAT | 2020


    Shared Control for Human-Robot Cooperative Manipulation Tasks

    Petrič, Tadej / Cevzar, Mišel / Babič, Jan | Springer Verlag | 2017


    Human-Robot Collaboration and Safety Management for Logistics and Manipulation Tasks

    Lim, Gi Hyun / Pedrosa, Eurico / Amaral, Filipe et al. | Springer Verlag | 2017


    Human-Multi-Robot Teleoperation for Cooperative Manipulation Tasks using Wearable Haptic Devices

    Music, Selma / Salvietti, Gionata / Dohmann, Pablo et al. | BASE | 2017

    Freier Zugriff