The traditional Double Deep Q-Network (DDQN) algorithm suffers from slow convergence and instability when dealing with complex environments. Besides, it is often susceptible to getting stuck in a local optimal solution and may fail to discover the optimal strategy. As a result, Unmanned Ground Vehicle (UGV) cannot search for the optimal path. To address these issues, the study presents an Improved Dueling Double Deep Q Network (ID3QN) algorithm, which adopts dynamic ε-greed strategy, priority experience replay (PER) and Dueling DQN structure. Where, UGV solves the problem of insufficient exploration and overexploitation according to the dynamic ε-greed strategy. Moreover, high-priority experience examples are extracted using the priority experience replay approach. Meanwhile, the Dueling DQN method can effectively manage the relationship between state values and dominance values. According to the experiment’s accomplishments, the ID3QN method outperforms the DDQN approach in terms of stability and rate of convergence, and obtains a better path in UGV path planning.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An Improved Dueling Double Deep Q Network Algorithm and Its Application to the Optimized Path Planning for Unmanned Ground Vehicle


    Additional title:

    Sae Technical Papers


    Contributors:
    Pang, Hui (author) / Liu, Lei (author) / Zheng, Lizhe (author) / Bai, Zekun (author) / He, Zhaonian (author)

    Conference:

    SAE 2023 Intelligent and Connected Vehicles Symposium ; 2023



    Publication date :

    2023-12-20




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Path Planning with Improved Dueling DQN Algorithm for UAVs in Unknown Dynamic Environment

    Wang, Wenshan / Zhang, Guoyin / Da, Qingan et al. | Springer Verlag | 2024



    Research on Dueling Double Deep Q Network Algorithm Based on Single-Step Momentum Update

    Shi, Peicheng / Zhang, Jianguo / Hai, Bin et al. | Transportation Research Record | 2023



    Multiple Unmanned Aerial Vehicle Autonomous Path Planning Algorithm Based on Whale-Inspired Deep Q-Network

    Wenshan Wang / Guoyin Zhang / Qingan Da et al. | DOAJ | 2023

    Free access