Unmanned Aerial Vehicles (UAVs) have been widely used in emergency rescue because of their small size and low cost, which can effectively reduce casualties and improve rescue efficiency. However, for UAV collision avoidance path planning in an unknown dynamic environment is a relatively difficult optimization problem. On the one hand, it is difficult for traditional algorithms to adapt to the huge state space generated by three-dimensional environment, which makes convergence difficult. On the other hand, the dynamic changing environment will affect the flight safety of UAVs. In this paper, an Improved Memory Pool Dueling Deep Q Network algorithm (IM-Dueling DQN) is proposed to optimize obstacle avoidance and path planning. Combined with the state and action space, a comprehensive reward function is designed to speed up the convergence of the algorithm and improve the generalization ability of the UAV to the environment. Experimental simulations show that the algorithm has good robustness in an unknown dynamic environment, and can avoid all obstacles and plan a safe navigation route.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Path Planning with Improved Dueling DQN Algorithm for UAVs in Unknown Dynamic Environment


    Additional title:

    Mechan. Machine Science


    Contributors:
    Li, Shaofan (editor) / Wang, Wenshan (author) / Zhang, Guoyin (author) / Da, Qingan (author) / Tian, Ye (author)

    Conference:

    International Conference on Computational & Experimental Engineering and Sciences ; 2023 ; Shenzhen, China May 26, 2023 - May 29, 2023



    Publication date :

    2024-01-25


    Size :

    13 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Dynamic obstacle avoidance path planning of UAVs

    Qian, Xue / Peng, Cheng / Nong, Cheng et al. | IEEE | 2015


    Path planning of UAVs formation based on improved ant colony optimization algorithm

    Qiannan, Zhao / Ziyang, Zhen / Chen, Gao et al. | IEEE | 2014


    Optimal path planning for UAVs using Genetic Algorithm

    Sonmez, Abdurrahim / Kocyigit, Emre / Kugu, Emin | IEEE | 2015