Imitation learning could enable non-expert users to teach new skills to robots in an interactive and intuitive way. Still, when teaching a task, it is often difficult to grasp what the robot knows or to assess if a correct task representation is being formed. To address this problem, suitable online feedback should be given by the robot to explain its perceptual beliefs.
Here, we introduce an explainable design for human-robot interaction during learning by demonstration of simple kitchen tasks in Augmented Reality. To communicate the robot feedback during the demonstration two modalities are explored: one purely AR-based (AR-XAI), by which the perceptual beliefs of the robot are interactively overlaid on the shared workspace, as perceived by the teacher; and one more human-like (gaze-speech), where the robot’s understanding is signaled by gaze following and verbal utterances. We conducted a user study to assess which modality is more effective in shaping the user perception and to evaluate whether a combination of holographic and embodied social cues would further improve the user experience. Our results show that the multi-modal combination is indeed best appreciated and contributes to a better perception of the robot, especially in non-experts.
Explainable Human-Robot Interaction for Imitation Learning in Augmented Reality
Springer Proceedings in Advanced Robotics
International Workshop on Human-Friendly Robotics ; 2023 ; Munich, Germany September 20, 2023 - September 21, 2023
2024-03-10
16 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Human-Robot Collaboration: An Augmented Reality Toolkit for Bi-Directional Interaction
BASE | 2023
|Spatial Augmented Reality and Eye Tracking for Evaluating Human Robot Interaction
BASE | 2016
|Concepts for End-to-end Augmented Reality based Human-Robot Interaction Systems
BASE | 2019
|