Trabajo presentado en la IEEE International Conference on Robotics and Automation (ICRA), conferencia virtual celebrada del 31 de mayo al 31 de agosto de 2020 ; Robotic manipulators are reaching a state where we could see them in household environments in the following decade. Nevertheless, such robots need to be easy to instruct by lay people. This is why kinesthetic teaching has become very popular in recent years, in which the robot is taught a motion that is encoded as a parametric function - usually a Movement Primitive (MP)-. This approach produces trajectories that are usually suboptimal, and the robot needs to be able to improve them through trial-and-error. Such optimization is often done with Policy Search (PS) reinforcement learning, using a given reward function. PS algorithms can be classified as model-free, where neither the environment nor the reward function are modelled, or model-based, which can use a surrogate model of the reward function and/or a model for the dynamics of the task. However, MPs can become very high-dimensional in terms of parameters, which constitute the search space, so their optimization often requires too many samples. In this paper, we assume we have a robot motion task characterized with an MP of which we cannot model the dynamics. We build a surrogate model for the reward function, that maps an MP parameter latent space (obtained through a Mutual-information-weighted Gaussian Process Latent Variable Model) into a reward. While we do not model the task dynamics, using mutual information to shrink the task space makes it more consistent with the reward and so the policy improvement is faster in terms of sample efficiency. ; This work was partially developed in the context of the project CLOTHILDE ("CLOTH manIpulation Learning from DEmonstrations"), which has received funding from the European Research Council (ERC) under the European Union’s Horizon 2020 research and innovation programme (Advanced Grant agreement No 741930). This work is also supported by the Spanish State Research Agency through the María de Maeztu Seal of Excellence to IRI MDM-2016-0656. ; Peer reviewed


    Access

    Download


    Export, share and cite



    Title :

    Sample-efficient robot motion learning using Gaussian process latent variable models



    Publication date :

    2020-01-01


    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    Contextual policy search for micro-data robot motion learning through covariate Gaussian process latent variable models

    Delgado-Guerrero, Juan Antonio / Colomé, Adrià / Torras, Carme | BASE | 2020

    Free access

    Learning GP-BayesFilters via Gaussian process latent variable models

    Ko, J. | British Library Online Contents | 2011


    Classification of Streetsigns Using Gaussian Process Latent Variable Models

    Wober, Wilfried / Aburaia, Mohamed / Olaverri-Monreal, Cristina | IEEE | 2019


    Gaussian process latent class choice models

    Sfeir, Georges / Rodrigues, Filipe / Abou-Zeid, Maya | Elsevier | 2021


    Unsupervised learning in radiology using novel latent variable models

    Carrivick, L. / Prabhu, S. / Goddard, P. et al. | IEEE | 2005