In human teams, visual and auditory cues are often used to communicate information about the task and/or environment that may not otherwise be directly observable. Analogously, robots that primarily rely on visual sensors cannot directly observe some attributes of objects that may be necessary for reference resolution or task execution. The experiments in this paper address natural language interaction in human-robot teams for tasks where multi-modal (e.g. visual, auditory, haptic, etc) observations are necessary for robust execution. We present a probabilistic model, verified through physical experiments, that allows robots to acquire knowledge about the latent aspects of the workspace through language and physical interaction in an efficient manner. The model’s effectiveness is demonstrated on a mobile and a stationary manipulator in real-world scenarios by following instructions under partial knowledge of object states in the environment.
Real-Time Human-Robot Communication for Manipulation Tasks in Partially Observed Environments
Springer Proceedings in Advanced Robotics
International Symposium on Experimental Robotics ; 2018 ; Buenos Aires, Argentina November 05, 2018 - November 08, 2018
Proceedings of the 2018 International Symposium on Experimental Robotics ; Kapitel : 39 ; 448-460
2020-01-23
13 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Shared Control for Human-Robot Cooperative Manipulation Tasks
Springer Verlag | 2017
|Human-Robot Collaboration and Safety Management for Logistics and Manipulation Tasks
Springer Verlag | 2017
|Human-Multi-Robot Teleoperation for Cooperative Manipulation Tasks using Wearable Haptic Devices
BASE | 2017
|Learning to solve manipulation tasks from non-expert users in human-centered environments
BASE | 2017
|