The challenging task of “intelligent vehicles” opens up a new frontier to enhancing traffic safety. However, how to determine driving behavior timely and effectively is one of the most crucial concerns, which directly affects vehicle's collision avoidance capability and dynamics stability, particularly in emergency scenarios. Here, this paper presents a novel model-based reinforcement learning (RL) solution for driving behavior decision-making of autonomous vehicles in emergency situations. Firstly, in order to generate initial training data, a rule-based expert system (ES) is designed by analyzing human drivers' emergency collision avoidance manipulations and tire dynamics characteristics. Secondly, an imitative learning (IL) algorithm is developed to clone ES's driving behavior through softmax classifier and mini-batch stochastic gradient descent (MSGD) method. Thirdly, A model-prediction-based Q(λ)-learning with function approximation is presented to determine driving policy online, which integrates vehicle system model and neural network model from IL. Finally, the results of both simulation and experiment show that our approach can effectively coordinate multiple motion control systems to improve collision avoidance capability and vehicle dynamics stability at or close to the driving limits.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Emergency Collision Avoidance Decision-making for Autonomous Vehicles: A Model-based Reinforcement Learning Approach


    Contributors:
    He, Xiangkun (author) / Lv, Chen (author) / Ji, Xuewu (author) / Liu, Yahui (author)


    Publication date :

    2022-10-28


    Size :

    6065880 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Collision avoidance decision-making method for autonomous vehicle

    WU BO / JIN GANG | European Patent Office | 2022

    Free access

    An Integrated MPC Approach for FWIA Autonomous Ground Vehicles with Emergency Collision Avoidance

    Cao, Mingcong / Wang, Rongrong / Wang, Jinxiang et al. | IEEE | 2018


    Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning

    Elallid, Badr Ben / Abouaomar, Amine / Benamar, Nabil et al. | ArXiv | 2023

    Free access

    High-Speed Collision Avoidance using Deep Reinforcement Learning and Domain Randomization for Autonomous Vehicles

    Kontes, Georgios D. / Scherer, Daniel D. / Nisslbeck, Tim et al. | IEEE | 2020


    Collision avoidance method for autonomous vehicles

    KIM KI HYUK | European Patent Office | 2021

    Free access