In this paper, we present a framework for the robot to learn how to place objects to a workpiece by learning from humans in smart manufacturing. In the proposed framework, the rational scene dictionary (RSD) corresponding to the keyframes of task (KFT) are used to identify the general object-action-location relationships. The Generalized Voronoi Diagrams (GVD) based contour is used to determine the relative position and orientation between the object and the corresponding workpiece at the final state. In the learning phase, we keep tracking the image segments in the human demonstration. For the moment when a spatial relation of some segments are changed in a discontinuous way, the state changes are recorded by the RSD. KFT is abstracted after traversing and searching in RSD, while the relative position and orientation of the object and the corresponding mount are presented by GVD-based contours for the keyframes. When the object or the relative position and orientation between the object and the workpiece are changed, the GVD, as well as the shape of contours extracted from the GVD, are also different. The Fourier Descriptor (FD) is applied to describe these differences on the shape of contours in the GVD. The proposed framework is validated through experimental results.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Modeling and Learning of Object Placing Tasks from Human Demonstrations in Smart Manufacturing


    Additional title:

    Sae Technical Papers


    Contributors:
    Krovi, Venkat N (author) / Wang, Weitian (author) / Chen, Yi (author) / Jia, Yunyi (author) / Zhang, Zhujun (author)

    Conference:

    WCX SAE World Congress Experience ; 2019



    Publication date :

    2019-04-02




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    ROBOT LEARNING OF OBJECT MANIPULATION TASK ACTIONS FROM HUMAN DEMONSTRATIONS

    Kyrarini, Maria / Haseeb, Muhammad Abdul / Ristić-Durrant, Danijela et al. | BASE | 2017

    Free access

    Learning continuous human-robot interactions from human-human demonstrations

    Vogt, David / Technische Universität Bergakademie Freiberg | TIBKAT | 2018

    Free access

    Parametrization of Compliant, Object-Level Controllers from Human Demonstrations

    Herrero, Elena Galbally / Piedra, Adrian / Brosque, Cynthia et al. | Springer Verlag | 2022


    Learning physical collaborative robot behaviors from human demonstrations

    Rozo Castañeda, Leonel / Calinon, Sylvain / Caldwell, Darwin et al. | BASE | 2016

    Free access

    Learning physical collaborative robot behaviors from human demonstrations

    Rozo, Leonel / Calinon, Sylvain / Caldwell, Darwin et al. | BASE | 2016

    Free access