The implementation of autonomous driving is inseparable from developing intelligent driving decision-making models, which are facing high scene complexity, poor decision-making coupling, and the inability to guarantee decision-making safety. This paper starts with the priority and logic of lane change and car-following decision-making, considering driving efficiency, safety, and comfort, then constructs a double-layer decision-making model. This paper uses two deep reinforcement learning algorithms for the upper and lower layers to process large-scale mixed state space and ensure the composite action output of lane-changing decisions and car-following decisions. In the upper layer model, we use the D3QN algorithm to distinguish the potential value of the environment and the value of selecting lane-changing actions when making lane-changing decisions. Different from the traditional mechanisms that only use negative rewards, the lane changing benefit function and dangerous action shielding mechanism are used to eliminate collisions. DDPG algorithm is adopted in the lower layer model to process car-following decisions and output continuous vehicle speed control. Besides, coupled training is taken for the two algorithms to improve the coordination of the double-layer model. This paper selected mixed standard driving cycle conditions to build a highly complex training environment and used NGSIM data to reconstruct scenes to test our model. Simulations in SUMO are presented that the double-layer model can increase the driving speed of the original data by 23.99%, which has higher effectiveness than other models.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    An Integrated Model for Autonomous Speed and Lane Change Decision-Making Based on Deep Reinforcement Learning


    Beteiligte:
    Peng, Jiankun (Autor:in) / Zhang, Siyu (Autor:in) / Zhou, Yang (Autor:in) / Li, Zhibin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.11.2022


    Format / Umfang :

    3914254 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Autonomous Lane Change Decision Making Using Different Deep Reinforcement Learning Methods

    Feng, Xidong / Hu, Jianming / Huo, Yusen et al. | ASCE | 2019


    Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning

    Hoel, Carl-Johan / Wolff, Krister / Laine, Leo | IEEE | 2018



    DRNet: A Decision-Making Method for Autonomous Lane Changingwith Deep Reinforcement Learning

    Xu, Kunpeng / Chen, Lifei / Wang, Shengrui | ArXiv | 2023

    Freier Zugriff