Legged locomotion is a challenging task for learning algorithms, especially when the task requires a diverse set of primitive behaviors. To solve these problems, we introduce a hierarchical framework to automatically decompose complex locomotion tasks. A high-level policy issues commands in a latent space and also selects for how long the low-level policy will execute the latent command. Concurrently, the low-level policy uses the latent command and only the robot's on-board sensors to control the robot's actuators. Our approach allows the high-level policy to run at a lower frequency than the low-level one. We test our framework on a path-following task for a dynamic quadruped robot and we show that steering behaviors automatically emerge in the latent command space as low-level skills are needed for this task. We then show efficient adaptation of the trained policy to a different task by transfer of the trained low-level policy. Finally, we validate the policies on a real quadruped robot. To the best of our knowledge, this is the first application of end-to-end hierarchical learning to a real robotic locomotion task.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Hierarchical Reinforcement Learning for Quadruped Locomotion


    Beteiligte:
    Jain, Deepali (Autor:in) / Iscen, Atil (Autor:in) / Caluwaerts, Ken (Autor:in)

    Erscheinungsdatum :

    2019


    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Animal-Like Eye Vision Assisted Locomotion of a Quadruped Based on Reinforcement Learning

    Wei, Xiaojian / Wei, Qing / An, Honglei et al. | TIBKAT | 2023


    Animal-Like Eye Vision Assisted Locomotion of a Quadruped Based on Reinforcement Learning

    Wei, Xiaojian / Wei, Qing / An, Honglei et al. | Springer Verlag | 2023


    Gait optimization method for quadruped locomotion

    Maicol Laurenza / Gianluca Pepe / Antonio Carcaterra | BASE | 2022

    Freier Zugriff