Reliable pedestrian crash avoidance mitigation (PCAM) systems are crucial components of safe autonomous vehicles (AVs). The nature of the vehicle-pedestrian interaction where decisions of one agent directly affect the other agent’s optimal behavior, and vice versa, is a challenging yet often neglected aspect of such systems. We address this issue by modeling a Markov decision process (MDP) for a simulated AV-pedestrian interaction at an unmarked crosswalk. The AV’s PCAM decision policy is learned through deep reinforcement learning (DRL). Since modeling pedestrians realistically is challenging, we compare two levels of intelligent pedestrian behavior. While the baseline model follows a predefined strategy, our advanced pedestrian model is defined as a second DRL agent. This model captures continuous learning and the uncertainty inherent in human behavior, making the AV-pedestrian interaction a deep multi-agent reinforcement learning (DMARL) problem. We benchmark the developed PCAM systems according to the collision rate and the resulting traffic flow efficiency with a focus on the influence of observation uncertainty on the decision-making of the agents. The results show that the AV is able to completely mitigate collisions under the majority of the investigated conditions and that the DRL pedestrian model learns an intelligent crossing behavior.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Modeling Interactions of Autonomous Vehicles and Pedestrians with Deep Multi-Agent Reinforcement Learning for Collision Avoidance


    Contributors:


    Publication date :

    2022-06-05


    Size :

    316800 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Collision Avoidance of Low Speed Autonomous Shuttles with Pedestrians

    Gelbal, Sukru Yaren / Aksun-Guvenc, Bilin / Guvenc, Levent | Springer Verlag | 2020


    Vehicles Control: Collision Avoidance using Federated Deep Reinforcement Learning

    Ben Elallid, Badr / Abouaomar, Amine / Benamar, Nabil et al. | IEEE | 2023


    High-Speed Collision Avoidance using Deep Reinforcement Learning and Domain Randomization for Autonomous Vehicles

    Kontes, Georgios D. / Scherer, Daniel D. / Nisslbeck, Tim et al. | IEEE | 2020



    Towards Safe Deep Reinforcement Learning for Autonomous Airborne Collision Avoidance Systems

    Panoutsakopoulos, Christos / Yuksek, Burak / Inalhan, Gokhan et al. | AIAA | 2022