Highlights A novel training platform for automated vehicle (AV)’s decision-making is proposed. Deep deterministic policy gradient algorithm is adopted for continuous state decision of AV. Details about reward setting and accelerated methods for DRL training are investigated. A multi-task driving model integrating CF and LC behavior is trained simultaneously.

    Abstract Automated vehicles (AVs) are deemed to be the key element for the intelligent transportation system in the future. Many studies have been made to improve AVs’ ability of environment recognition and vehicle control, while the attention paid to decision making is not enough and the existing decision algorithms are very preliminary. Therefore, a framework of the decision-making training and learning is put forward in this paper. It consists of two parts: the deep reinforcement learning (DRL) training program and the high-fidelity virtual simulation environment. Then the basic microscopic behavior, car-following (CF), is trained within this framework. In addition, theoretical analysis and experiments were conducted to evaluate the proposed reward functions for accelerating training using DRL. The results show that on the premise of driving comfort, the efficiency of the trained AV increases 7.9% and 3.8% respectively compared to the classical adaptive cruise control models, intelligent driver model and constant-time headway policy. Moreover, on a more complex three-lane section, we trained an integrated model combining both CF and lane-changing behavior, with the average speed further growing 2.4%. It indicates that our framework is effective for AV’s decision-making learning.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Automated vehicle’s behavior decision making using deep reinforcement learning and high-fidelity simulation environment


    Contributors:
    Ye, Yingjun (author) / Zhang, Xiaohui (author) / Sun, Jian (author)


    Publication date :

    2019-08-11


    Size :

    16 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Automated Speed and Lane Change Decision Making using Deep Reinforcement Learning

    Hoel, Carl-Johan / Wolff, Krister / Laine, Leo | IEEE | 2018




    Spacecraft Decision-Making Autonomy Using Deep Reinforcement Learning

    Harris, Andrew / Teil, Thibaud / Schaub, Hanspeter | TIBKAT | 2019