In highway traffic environment, vehicle lane-change decisions are a critical and difficult task for an agent. The traditional deep Q-network (DQN) has been the main architecture used for this task. However, DQN still faces two major challenges in solving the lane-changing decision-making problem for autonomous driving: 1) the instability in the training process leads to frequent collisions and 2) the single reward function limits the agent’s ability to learn representative domain knowledge about highways. To address these issues, this paper proposes a multi-reward DQN for highway driving decisions, with long short-term memory (LSTM) and self-attention. We call this model LAMRDQN. It incorporates LSTM and self-attention mechanism into Q-network to reduce frequent collisions. In addition, the unitary reward is changed into multiple reward functions—each reward emphasizing a specific factor, such as speed, obeying traffic rules, and lane changing. The use of multiple rewards enables the model to capture and optimize various aspects of autonomous driving on highway tasks, thereby obtaining more representative domain knowledge. The experiment results show that, in the highway environment, the method can effectively improve the problems of frequent collisions and poor learning performance when vehicles change lanes, and has better overtaking performance than related reinforcement learning algorithms.


    Access

    Download

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Lane-Change Decision of Automatic Driving Based on Reinforcement Learning Framework


    Additional title:

    Transportation Research Record: Journal of the Transportation Research Board


    Contributors:
    Li, Jiaxin (author) / Liu, Gang (author) / Chen, Zhiyu (author) / Guo, Jianwei (author)


    Publication date :

    2024-09-09




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Automatic driving lane keeping decision-making method based on deep reinforcement learning

    LIU HAOLIN / ZHANG XIAOHUI / BAI WENQI et al. | European Patent Office | 2025

    Free access

    Hybrid automatic driving lane changing decision-making method based on deep reinforcement learning

    LIANG SHANSHAN / ZHANG JIE / CHEN CHONGCHONG et al. | European Patent Office | 2024

    Free access

    Automatic driving lane selection decision-making method and system based on inverse reinforcement learning

    SONG MINGLI / QING YUNPENG / LIU SHUNYU et al. | European Patent Office | 2023

    Free access

    Automatic driving vehicle lane changing decision system and method based on deep reinforcement learning

    XIONG MINGQIANG / QIAO JIE / JIANG MENG et al. | European Patent Office | 2022

    Free access