In highway traffic environment, vehicle lane-change decisions are a critical and difficult task for an agent. The traditional deep Q-network (DQN) has been the main architecture used for this task. However, DQN still faces two major challenges in solving the lane-changing decision-making problem for autonomous driving: 1) the instability in the training process leads to frequent collisions and 2) the single reward function limits the agent’s ability to learn representative domain knowledge about highways. To address these issues, this paper proposes a multi-reward DQN for highway driving decisions, with long short-term memory (LSTM) and self-attention. We call this model LAMRDQN. It incorporates LSTM and self-attention mechanism into Q-network to reduce frequent collisions. In addition, the unitary reward is changed into multiple reward functions—each reward emphasizing a specific factor, such as speed, obeying traffic rules, and lane changing. The use of multiple rewards enables the model to capture and optimize various aspects of autonomous driving on highway tasks, thereby obtaining more representative domain knowledge. The experiment results show that, in the highway environment, the method can effectively improve the problems of frequent collisions and poor learning performance when vehicles change lanes, and has better overtaking performance than related reinforcement learning algorithms.


    Zugriff

    Download

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Lane-Change Decision of Automatic Driving Based on Reinforcement Learning Framework


    Weitere Titelangaben:

    Transportation Research Record: Journal of the Transportation Research Board


    Beteiligte:
    Li, Jiaxin (Autor:in) / Liu, Gang (Autor:in) / Chen, Zhiyu (Autor:in) / Guo, Jianwei (Autor:in)


    Erscheinungsdatum :

    09.09.2024




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Automatic driving lane keeping decision-making method based on deep reinforcement learning

    LIU HAOLIN / ZHANG XIAOHUI / BAI WENQI et al. | Europäisches Patentamt | 2025

    Freier Zugriff

    Hybrid automatic driving lane changing decision-making method based on deep reinforcement learning

    LIANG SHANSHAN / ZHANG JIE / CHEN CHONGCHONG et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Automatic driving vehicle lane changing decision system and method based on deep reinforcement learning

    XIONG MINGQIANG / QIAO JIE / JIANG MENG et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Automatic driving lane selection decision-making method and system based on inverse reinforcement learning

    SONG MINGLI / QING YUNPENG / LIU SHUNYU et al. | Europäisches Patentamt | 2023

    Freier Zugriff