To proactively navigate and traverse various terrains, active use of visual perception becomes indispensable. We aim to investigate the feasibility and performance of using sparse visual observations to achieve perceptual locomotion over a range of common terrains (steps, ramps, gaps, and stairs) in human-centered environments. We formulate a selection of sparse visual inputs suitable for locomotion over the terrains of interest, and propose a learning framework to integrate exteroceptive and proprioceptive states. We design state observations and a training curriculum to learn feedback control policies effectively over a range of different terrains. We extensively validate and benchmark the learned policy in various tasks: omnidirectional walking on flat ground, and forward locomotion over various obstacles, showing high success rate of traversability. Furthermore, we study exteroceptive ablations and evaluate policy generalization by adding various levels of noise and testing on new unseen terrains. We demonstrate the capabilities of autonomous perceptual locomotion that can be achieved by only using sparse visual observations from direct depth measurements, which are easily available from a Lidar or RGB-D sensor, showing robust ascent and descent over high stairs of 20 cm height, i.e., 50% leg length, and robustness against noise and unseen terrains.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Learning Perceptual Locomotion on Uneven Terrains using Sparse Visual Observations


    Beteiligte:
    Acero, F (Autor:in) / Yuan, K (Autor:in) / Li, Z (Autor:in)

    Erscheinungsdatum :

    2022-10-01


    Anmerkungen:

    IEEE Robotics and Automation Letters , 7 (4) pp. 8611-8618. (2022)


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Adaptive Locomotion on Uneven Terrains

    Hauser, Kris | Springer Verlag | 2018


    DRONE WITH LANDING CAPABILITY ON UNEVEN TERRAINS

    PARPARA DAVID | Europäisches Patentamt | 2022

    Freier Zugriff

    Using pedestrians walking on uneven terrains for camera calibration

    Junejo, I. N. | British Library Online Contents | 2011


    EXHAUST DEVICE AND VEHICLE FOR TRAVEL ON UNEVEN TERRAINS

    TAJIMA ATSUSHI / ORIHASHI YOSHIHIKO | Europäisches Patentamt | 2022

    Freier Zugriff

    Enhancing Efficiency of Quadrupedal Locomotion Over Challenging Terrains with Extensible Feet

    Kumar, Lokesh / Sortee, Sarvesh / Bera, Titas et al. | IEEE | 2023