Collision avoidance is a crucial technique to achieve safe and efficient robotic vehicle navigation in unknown environments. However, moving obstacles with unpredictability in dynamic scenarios, usually increase the difficulty and complexity in collision avoidance of robotic vehicles. To enhance the stability of collision avoidance and boost its adaptability to uncertain dynamic scenes, a new attention-based value classification actor-critic (AVCAC) architecture is proposed. It is an end-to-end robot navigation model that utilizes imperfect local observation to directly plan accurate collision-free motion commands. First, we design a value-classified rollout replaybuffer to categorize the experiences into different pools. It can prevent any overfitting or bias that may result from repeatedly sampling experiences of a certain type during policy learning. Then, we improve the conventional actor-critic network with a multi-head local attention module to extract the local observations at entity-level. This way, the collision avoidance system can focus on key environmental features to operate more efficiently and respond more swiftly to dynamic changes in the environment. Moreover, a lookahead multi-step prediction (LMP) reward setting is devised in the AVCAC-based reinforcement learning (RL) framework to facilitate more informed and forward-looking decision-making. Finally, the policy entropy (PE) and policy delay (PD) are extended to AVCAC model to enhance policy exploration and make policy more robust. Extensive experimental results reveal that our method can generate time-efficient and collision-free guide paths to dodge collisions under complex dynamic environments.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Attention-Based Value Classification Reinforcement Learning for Collision-Free Robot Navigation


    Beteiligte:
    Sun, Chao (Autor:in) / Wu, Xing (Autor:in) / Wang, Yuanda (Autor:in) / Sun, Changyin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.11.2024


    Format / Umfang :

    5010214 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Learning-Based Navigation and Collision Avoidance Through Reinforcement for UAVs

    Azzam, Rana / Chehadeh, Mohamad / Hay, Oussama Abdul et al. | IEEE | 2024

    Freier Zugriff

    Deep Reinforcement Learning for Mobile Robot Navigation

    Gromniak, Martin / Stenzel, Jonas | BASE | 2019

    Freier Zugriff

    Autonomous Quantum Reinforcement Learning for Robot Navigation

    Mohan, Arjun / Jayabalan, Sudharsan / Mohan, Archana | Springer Verlag | 2016