Programming by Demonstration (PbD) is an intuitive method to transfer knowledge from a non-expert human teacher to a robot. To allow the non-expert user to intuitively understand what the robot has learned from the demonstration, we propose a framework that detects online which skills the human is demonstrating and builds from that a graph that describes how the task is performed. The skill recognition is achieved by a segmentation algorithm that combines symbolic skill segmentation, which makes use of pre- and postconditions to identify skills, with data-driven segmentation, which uses Support Vector Machines to learn to classify the skills from data. The framework is thus able to detect force-based skills in addition to manipulation skills, to allow the flexible use of robots in assembly production lines. The intuitiveness of the framework is evaluated in a user study that compares the task graph representation of our framework to the time-line based representation of an existing PbD framework that does not make use of skill recognition.


    Access

    Download


    Export, share and cite



    Title :

    Intuitive Knowledge Representations for Interactive Robot Programming


    Contributors:

    Publication date :

    2021-04-15


    Type of media :

    Miscellaneous


    Type of material :

    Electronic Resource


    Language :

    English




    Extended State Automata for Intuitive Robot Programming

    Sauer, Lukas / Henrich, Dominik | TIBKAT | 2021


    Intuitive robot programming for novice and expert user

    Steinmetz, Franz Josef | TIBKAT | 2022

    Free access

    An interactive strategic mission management system for intuitive human-robot cooperation

    Kirchner, Elsa Andrea / Langer, Hagen / Beetz, Michael | TIBKAT | 2020


    User-Centered Design of an Intuitive Robot Playback Programming System

    Colceriu, Christian / Riedl, Michael / Henrich, Dominik et al. | Springer Verlag | 2020

    Free access

    Intuitive Robot Teaching by Hand Guided Demonstration

    Zhao, Lijun / Li, Xiaoyu / Liang, Peidong et al. | British Library Conference Proceedings | 2016