Intersections are key nodes and also bottlenecks of urban road networks, so improving the traffic efficiency at intersections is beneficial to improving overall traffic throughput and mitigating traffic congestion. Previous methods such as rule-based, planning-based, and single-agent reinforcement learning usually oversimplify the policies of the surrounding vehicles and thus have difficulty modeling the complex interaction behaviors between vehicles, which limits the performance of these methods to some extent. Instead, we adopt a multi-agent reinforcement learning (MARL) approach to train and coordinate the policies of all vehicles to handle unsignalized intersection scenarios. Nevertheless, due to complex interactions between multiple agents, it is challenging to efficiently explore the environment and obtain high-reward samples. We therefore propose to pre-train the policy using demonstration data consisting of expert data and interaction data to improve the initial performance of agents and improve exploration, as well as to reduce the distributional shift between the demonstration data and the environmental interaction data. We experimentally prove that using interaction data generated by the algorithm in the demonstration data improves training stability. The proposed method enables effective exploration and greatly speeds up the training process.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-agent Decision-making at Unsignalized Intersections with Reinforcement Learning from Demonstrations


    Beteiligte:
    Huang, Chang (Autor:in) / Zhao, Junqiao (Autor:in) / Zhou, Hongtu (Autor:in) / Zhang, Hai (Autor:in) / Zhang, Xiao (Autor:in) / Ye, Chen (Autor:in)


    Erscheinungsdatum :

    2023-06-04


    Format / Umfang :

    1236269 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Unsignalized Intersections

    Elefteriadou, Lily | Springer Verlag | 2013


    A Multi-Task Reinforcement Learning Approach for Navigating Unsignalized Intersections

    Kai, Shixiong / Wang, Bin / Chen, Dong et al. | IEEE | 2020


    Unsignalized Intersections: Roundabouts

    Prassas, Elena S. / P. Roess, Roger | Springer Verlag | 2020


    Delay at Unsignalized Intersections

    Brilon, Werner | Online Contents | 2008


    Delay at Unsignalized Intersections

    Brilon, Werner | Transportation Research Record | 2008