In this paper, we propose a Q-learning based decision-making framework to improve the safety and efficiency of Autonomous Vehicles when they encounter other maliciously behaving vehicles while passing through unsignalized intersections. In Autonomous Vehicles, conventional reward signals are set as regular rewards regarding feedback factors such as safety and efficiency. In this paper, safety gains are modulated by variable weighting parameters to ensure that safety can be emphasized more in emergency situations. The framework proposed in this paper introduces first-order theory of mind inferences on top of conventional rewards, using first-order beliefs as additional reward signals. The decision framework enables Autonomous Vehicles to make informed decisions when encountering vehicles with potentially malicious behaviors at unsignalized intersections, thereby improving the overall safety and efficiency of Autonomous Vehicle transportation systems. In order to verify the performance of the decision framework, this paper uses Prescan/Simulink co-simulations for simulation, and the results show that the performance of the decision framework can meet the set requirements.


    Access

    Download


    Export, share and cite



    Title :

    Autonomous Vehicle Decision-Making Framework for Considering Malicious Behavior at Unsignalized Intersections


    Contributors:
    Li, Qing (author) / Hua, Jinxing (author) / Sun, Qiuxia (author)

    Publication date :

    2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Unsignalized Intersections

    Guerrieri, Marco / Mauro, Raffaele | Springer Verlag | 2020


    Unsignalized Intersections

    Elefteriadou, Lily | Springer Verlag | 2013


    Decision Making for Autonomous Vehicles at Unsignalized Intersection in Presence of Malicious Vehicles

    Pruekprasert, Sasinee / Zhang, Xiaoyi / Dubut, Jérémy et al. | ArXiv | 2019

    Free access

    Decision Making for Autonomous Vehicles at Unsignalized Intersection in Presence of Malicious Vehicles

    Pruekprasert, Sasinee / Zhang, Xiaoyi / Dubut, Jeremy et al. | IEEE | 2019


    Connected autonomous vehicle driving path optimization method for unsignalized intersections

    Zhang, Zhi / Rao, Bowen / Long, Guansen et al. | British Library Conference Proceedings | 2023