Mandatory lane-change scenarios are often challenging for autonomous vehicles in complex environments. In this paper, a human-knowledge-enhanced reinforcement learning (RL) method for lane-change decision making is proposed, where the human intelligence is integrated with RL algorithm in a multiple manner. First, this paper constructs a complex ramp-off scenario with congested traffic flow to help agents master lane-change skills. On the basis of the Twin Delayed Deep Deterministic policy gradient (TD3) algorithm, the human prior experience is encoded into reward function and safety constraints offline, and the online guidance of experts is also introduced into the framework, which can limit the unsafe exploration during the training process and provide demonstration in complex scenarios. The experimental results indicate that our method can effectively improve the training efficiency and outperform typical RL method and expert drivers, without specific requirements on the expertise. The proposed method can enhance the learning ability of RL based driving strategies.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Human Knowledge Enhanced Reinforcement Learning for Mandatory Lane-Change of Autonomous Vehicles in Congested Traffic


    Contributors:
    Huang, Yanjun (author) / Gu, Yuxiao (author) / Yuan, Kang (author) / Yang, Shuo (author) / Liu, Tao (author) / Chen, Hong (author)

    Published in:

    Publication date :

    2024-02-01


    Size :

    3380511 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Cooperative Lane Change Model for Connected Vehicles under Congested Traffic Conditions

    Wang, Di / Wang, Jianqiang / Wang, Yunpeng et al. | ASCE | 2015


    Analysing driving efficiency of mandatory lane change decision for autonomous vehicles

    Cao, Peng / Xu, Zhandong / Fan, Qiaochu et al. | IET | 2018

    Free access

    Analysing driving efficiency of mandatory lane change decision for autonomous vehicles

    Cao, Peng / Xu, Zhandong / Fan, Qiaochu et al. | Wiley | 2019

    Free access

    Meta Reinforcement Learning-Based Lane Change Strategy for Autonomous Vehicles

    Ye, Fei / Wang, Pin / Chan, Ching-Yao et al. | IEEE | 2021