Autonomous navigation is one of the most critical elementary skills to control UAV navigate around the environment without colliding with obstacles. As UAVs are prevalently applied in many domains, such as goods delivery, search and rescue and intelligent transportation etc, safety and efficiency are two basic requirements while executing tasks. However, autonomous navigation is not a trivial task because it is challenging for UAV to observe, orientate, decide and take actions simultaneously. Specially, in large-scale complex environments, the constrained narrow passages, dense obstacles and dynamic objects pose increasing difficulty. In this article, UAV autonomous navigation is modeled as a Markov decision process and an Improved Deep Deterministic Policy Gradient (ImDDPG) algorithm is proposed to make safe and efficient navigation decisions. In ImDDPG, the actor network is decomposed into two sub-networks to learn a more stable action policy. Next, some reward reshaping functions are developed to solve the sparse reward problem. Then, the convergence speed is further accelerated with a dynamic decay strategy. The targeting neural network is well designed and trained. Simulation experiments are conducted to prove that the proposed ImDDPG algorithm can achieve a success rate more than 95% in large-scale complex environments. Moreover, numerous simulation results are also presented to demonstrate that ImDDPG has better generalization ability than the benchmark DDPG and TD3 algorithms in environments with denser obstacles and dynamic objects.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    An Improved DDPG Algorithm for UAV Navigation in Large-Scale Complex Environments


    Beteiligte:
    Peng, Jiabin (Autor:in) / Lv, Bo (Autor:in) / Zhang, Lijuan (Autor:in) / Lei, Lei (Autor:in) / Song, Xiaoqin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-03-04


    Format / Umfang :

    1953976 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Autopilot Strategy Based on Improved DDPG Algorithm

    Zuo, Xiaochao / Li, Xiaoning / Tian, Zhewen | SAE Technical Papers | 2019


    Decentralized adaptive calculation unloading method based on DDPG algorithm

    HONG XINTAO / WANG LEI / LIANG HONGBIN | Europäisches Patentamt | 2024

    Freier Zugriff

    Research on dynamic path planning of mobile robot based on improved DDPG algorithm

    Li, Peng / Ding, Xiangcheng / Sun, Hongfang et al. | BASE | 2021

    Freier Zugriff

    An Intelligent Attitude Control Method for UAV Based on DDPG Algorithm

    Xian, Yuewei / Wang, Peng / Xin, Hongbo et al. | IEEE | 2023


    Collision avoidance path planning of tourist ship based on DDPG algorithm

    Yi ZHOU / Chuanping YUAN / Haicheng XIE et al. | DOAJ | 2021

    Freier Zugriff