Local planning is a critical and difficult task for intelligent vehicles in dynamic transportation environments. In this paper, a new method Suppress Q Deep Q Network (SQDQN) combining traditional deep reinforcement learning Deep Q Network (DQN) with information entropy is proposed for local planning in automatic driving. In the proposed approach, local planning strategy in complex traffic environment established by the actor–critic network based on DQN, the method adopts the way of execution action-evaluation action-update network to explore the optimal local planning strategy. Proposed strategy does not rely on accurate modeling of the scene, so it is suitable for complex and changeable traffic scenes. At the same time, evaluate the update process and determine the update range by using information entropy to solve a common problem in the network that over expectation of actions damage the performance of strategies. Use this approach to improve strategic performance. The trained local planning strategy is evaluated in three simulation scenarios: overtaking, following, driving in hazardous situations. The results illustrate the advantages of the proposed SQDQN method in solving local planning problem.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Local Planning Strategy Based on Deep Reinforcement Learning Over Estimation Suppression


    Additional title:

    Int.J Automot. Technol.


    Contributors:
    Han, Ling (author) / Wang, Yiren (author) / Chi, Ruifeng (author) / Fang, Ruoyu (author) / Liu, Guopeng (author) / Yi, Qiang (author) / Zhu, Changsheng (author)

    Published in:

    Publication date :

    2024-08-01


    Size :

    12 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Local Planning Strategy Based on Deep Reinforcement Learning Over Estimation Suppression

    Han, Ling / Wang, Yiren / Chi, Ruifeng et al. | Springer Verlag | 2024


    Deep Reinforcement Learning-Based Local Path Planning with Memory-Guided

    Wang, Xu / Xu, Xiaobin / Lin, Shiyao et al. | Springer Verlag | 2025


    Deep Reinforcement Learning-Based UAV Path Planning Algorithm

    Wang, Kunfu / Hui, Ma / Hou, Jiajun et al. | IEEE | 2024


    Automatic driving decision planning method based on deep reinforcement learning and deep learning

    YANG LU / ZHANG HAO / TAN YANSONG et al. | European Patent Office | 2024

    Free access

    Multiobjective Battery Charging Strategy Based on Deep Reinforcement Learning

    Xiong, Zheng / Luo, Biao / Wang, Bing-Chuan et al. | IEEE | 2024