Modeling other drivers' behavior in highly interactive traffic situations, such as roundabouts, is a challenging task. We address this task using a Multi-Agent Reinforcement Learning (MARL) approach that learns a driving policy based on a minimal set of assumptions: drivers want to move forward and avoid collisions while maintaining low accelerations. Each agent's actions depend only on his observation of the local environment; no explicit communication between agents is possible. In order to teach the agents to safely interact with each other, and for example, respect right-of-way rules, we use parameter sharing: During training all vehicles are controlled by the same policy and the aggregated experiences are used to improve the policy. Moreover, parameter sharing enables us to use the efficient Soft Actor Critic (SAC) algorithm for training. The approach is evaluated in a roundabout setting with different traffic densities. Furthermore, the ability of the model to generalize is assessed in an untrained roundabout. In both settings, success rates above 97 % demonstrate that a safe and transferable policy is learned.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Parameter Sharing Reinforcement Learning for Modeling Multi-Agent Driving Behavior in Roundabout Scenarios




    Publication date :

    2021-09-19


    Size :

    844735 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Intelligent Roundabout Insertion using Deep Reinforcement Learning

    Capasso, Alessandro Paolo / Bacchiani, Giulio / Molinari, Daniele | ArXiv | 2020

    Free access

    Mastering Cooperative Driving Strategy in Complex Scenarios using Multi-Agent Reinforcement Learning

    Liang, Qingyi / Jiang, Zhengmin / Yin, Jianwen et al. | IEEE | 2023


    Modeling Driving Behavior at Roundabouts: Impact of Roundabout Layout and Surrounding Traffic on Driving Behavior

    Zhao, Min / Käthner, David / Söffker, Dirk et al. | German Aerospace Center (DLR) | 2017

    Free access

    DRIVING GUIDE SYSTEM FOR ROUNDABOUT

    CHO CHAE IL | European Patent Office | 2022

    Free access