Despite some successful applications of goal-driven navigation, existing deep reinforcement learning (DRL)-based approaches notoriously suffers from poor data efficiency issue. One of the reasons is that the goal information is decoupled from the perception module and directly introduced as a condition of decision-making, resulting in the goal-irrelevant features of the scene representation playing an adversary role during the learning process. In light of this, we present a novel Goal-guided Transformer-enabled reinforcement learning (GTRL) approach by considering the physical goal states as an input of the scene encoder for guiding the scene representation to couple with the goal information and realizing efficient autonomous navigation. More specifically, we propose a novel variant of the Vision Transformer as the backbone of the perception system, namely Goal-guided Transformer (GoT), and pre-train it with expert priors to boost the data efficiency. Subsequently, a reinforcement learning algorithm is instantiated for the decision-making system, taking the goal-oriented scene representation from the GoT as the input and generating decision commands. As a result, our approach motivates the scene representation to concentrate mainly on goal-relevant features, which substantially enhances the data efficiency of the DRL learning process, leading to superior navigation performance. Both simulation and real-world experimental results manifest the superiority of our approach in terms of data efficiency, performance, robustness, and sim-to-real generalization, compared with other state-of-the-art (SOTA) baselines. The demonstration video (https://www.youtube.com/watch?v=aqJCHcsj4w0) and the source code (https://github.com/OscarHuangWind/DRL-Transformer-SimtoReal-Navigation) are also provided.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Goal-Guided Transformer-Enabled Reinforcement Learning for Efficient Autonomous Navigation


    Beteiligte:
    Huang, Wenhui (Autor:in) / Zhou, Yanxin (Autor:in) / He, Xiangkun (Autor:in) / Lv, Chen (Autor:in)


    Erscheinungsdatum :

    01.02.2024


    Format / Umfang :

    3881658 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Autonomous UAV Navigation Using Reinforcement Learning

    Pham, Huy X. / La, Hung M. / Feil-Seifer, David et al. | ArXiv | 2018

    Freier Zugriff


    Efficient reinforcement learning of navigation strategies in an autonomous robot

    Millán, José del R. / Torras, Carme | BASE | 1994

    Freier Zugriff

    Autonomous Quantum Reinforcement Learning for Robot Navigation

    Mohan, Arjun / Jayabalan, Sudharsan / Mohan, Archana | Springer Verlag | 2016


    Autonomous vehicle navigation with deep reinforcement learning

    Cabañeros López, Àlex | BASE | 2019

    Freier Zugriff