Learning motion tasks in a real environment with deformable objects requires not only a Reinforcement Learning (RL) algorithm, but also a good motion characterization, a preferably compliant robot controller, and an agent giving feedback for the rewards/costs in the RL algorithm. In this paper, we unify all these parts in a simple but effective way to properly learn safety-critical robotic tasks such as wrapping a scarf around the neck (so far, of a mannequin). We found that a suitable compliant controller ought to have a good Inverse Dynamic Model (IDM) of the robot. However, most approaches to build such a model do not consider the possibility of having hystheresis on the friction, which is the case for robots such as the Barrett WAM. For this reason, in order to improve the available IDM, we derived an analytical model of friction in the seven robot joints, whose parameters can be automatically tuned for each particular robot. This permits compliantly tracking diverse trajectories in the whole workspace. By using such friction-aware controller, Dynamic Movement Primitives (DMP) as motion characterization and visual/force feedback within the RL algorithm, experimental results demonstrate that the robot is consistently capable of learning such safety-critical tasks. ; Peer Reviewed ; Postprint (author's final draft)


    Access

    Download


    Export, share and cite



    Title :

    A friction-model-based framework for reinforcement learning of robotic tasks in non-rigid environments



    Publication date :

    2015-01-01



    Type of media :

    Miscellaneous


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    A friction-model-based framework for Reinforcement Learning of robotic tasks in non-rigid environments

    Colomé, Adrià / Planells, Antoni / Torras, Carme | BASE | 2015

    Free access

    Reinforcement learning for robotic assisted tasks

    Civit Bertran, Aniol | BASE | 2020

    Free access


    Exploiting symmetries in reinforcement learning of bimanual robotic tasks

    Amadio, Fabio / Colomé, Adrià / Torras, Carme | BASE | 2019

    Free access

    Exploiting symmetries in reinforcement learning of bimanual robotic tasks

    Amadio F. / Colome A. / Torras C. | BASE | 2019

    Free access