Autonomous service robots have become a key research topic in robotics, particularly for household chores. A typical home scenario is highly unconstrained and a service robot needs to adapt constantly to new situations. In this paper, we address the problem of autonomous cleaning tasks in uncontrolled environments. In our approach, a human instructor uses kinestethic demonstrations to teach a robot how to perform different cleaning tasks on a table. Then, we use Task Parametrized Gaussian Mixture Models (TP-GMMs) to encode the demonstrations variability, while providing appropriate generalization abilities. TP-GMMs extend Gaussian Mixture Models with an auxiliary set of reference frames, in order to extrapolate the demonstrations to different task parameters such as movement locations, amplitude or orientations. However, the reference frames (that parametrize TP-GMMs) can be very difficult to extract in practice, as it may require segmenting the cluttered images of the working table-top. Instead, in this work the reference frames are automatically extracted from robot camera images, using a deep neural network that was trained during human demonstrations of a cleaning task. This approach has two main benefits: (i) it takes the human completely out of the loop while performing complex cleaning tasks; and (ii) the network is able to identify the specific task to be performed directly from image data, thus also enabling automatic task selection from a set of previously demonstrated tasks. The system was implemented on the iCub humanoid robot. During the tests, the robot was able to successfully clean a table with two different types of dirt (wiping a marker's scribble or sweeping clusters of lentils).


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    ICub, clean the table! A robot learning from demonstration approach using deep neural networks



    Erscheinungsdatum :

    2018-01-01



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Self-supervised solutions for developmental learning with the humanoid robot iCub.

    GONZALEZ, JONAS PIERRE GUSTAVO | BASE | 2021

    Freier Zugriff

    The mechatronic design of the new legs of the iCub robot

    Parmiggiani, Alberto / Metta, Giorgio / Tsagarakis, Nikos | IEEE | 2012



    Magic iCub: a Humanoid Robot Autonomously Catching Your Lies in a Card Game

    Dario Pasquali / Jonas Gonzalez-Billandon / Francesco Rea et al. | BASE | 2021

    Freier Zugriff

    "iCub, We Forgive You!" Investigating Trust in a Game Scenario with Kids

    Francesca Cocchella / Giulia Pusceddu / Giulia Belgiovine et al. | BASE | 2022

    Freier Zugriff