Deep Q Network (DQN) has several limitations when applied in planning a path in environment with a number of dilemmas according to our experiment. The reward function may be hard to model, and successful experience transitions are difficult to find in experience replay. In this context, this paper proposes an improved Double DQN (DDQN) to solve the problem by reference to A* and Rapidly-Exploring Random Tree (RRT). In order to achieve the rich experiments in experience replay, the initialization of robot in each training round is redefined based on RRT strategy. In addition, reward for the free positions is specially designed to accelerate the learning process according to the definition of position cost in A*. The simulation experimental results validate the efficiency of the improved DDQN, and robot could successfully learn the ability of obstacle avoidance and optimal path planning in which DQN or DDQN has no effect.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    An Improved Algorithm of Robot Path Planning in Complex Environment Based on Double DQN


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Yan, Liang (Herausgeber:in) / Duan, Haibin (Herausgeber:in) / Yu, Xiang (Herausgeber:in) / Zhang, Fei (Autor:in) / Gu, Chaochen (Autor:in) / Yang, Feng (Autor:in)


    Erscheinungsdatum :

    2021-10-30


    Format / Umfang :

    11 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Robot Path Planning Research Incorporating Improved A* Algorithm and DWA Algorithm

    Qu, Shiya / Feng, Guang / Jiang, Yuhang et al. | BASE | 2023

    Freier Zugriff

    An Improved Algorithm of Path Planning for a Mobile Robot

    Jia, Xue Mei ;Sun, Qi Yuan | Trans Tech Publications | 2013


    An Improved Artificial Electric Field Algorithm for Robot Path Planning

    Tang, Jun / Pan, Qingtao / Chen, Zhishuai et al. | IEEE | 2024


    Autonomous driving path planning algorithm based on improved A* algorithm in unstructured environment

    Min, Haitao / Xiong, Xiaoyong / Wang, Pengyu et al. | SAGE Publications | 2021