Deep reinforcement learning (DRL) has become a powerful method for autonomous driving while often lacking safety guarantees. In this paper, we propose a Risk-fused Constraint Deep Reinforcement Learning (RCDRL) with D3QN network for safe decision making in lane change maneuver. The problem is formulated as a state-wise MDP (SCMDP), which embeds a rule-based risk-fused Constraint module. We map the decision action to the trajectory layer via a polynomial curve-based trajectory planner, which is combined with the predicted trajectories of surrounding vehicles to assess future risk and correct the unsafe action. Therefore, the proposed method can deal with unsafe decision actions when training the policy network. To investigate the decision performance, the trained RCDRL policy is tested and validated under different traffic densities. In particular, we implement real vehicle tests to validate the effectiveness of the proposed method. Simulation and real vehicle tests demonstrated that the proposed RCDRL method achieves better performance, especially in safe decision. In addition, the framework can be extended with other advanced DRL networks.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Safe Reinforcement Learning of Lane Change Decision Making with Risk-Fused Constraint


    Contributors:
    Li, Zhuoren (author) / Xiong, Lu (author) / Leng, Bo (author) / Xu, Puhang (author) / Fu, Zhiqing (author)


    Publication date :

    2023-09-24


    Size :

    1116257 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English





    Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning

    Hoel, Carl-Johan / Wolff, Krister / Laine, Leo | IEEE | 2018


    Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change

    Xu, Ruichen / Liu, Xiao / Xu, Jinming et al. | ArXiv | 2024

    Free access

    Autonomous Lane Change Decision Making Using Different Deep Reinforcement Learning Methods

    Feng, Xidong / Hu, Jianming / Huo, Yusen et al. | ASCE | 2019