Multi-Agent Reinforcement Learning (MARL) has reached astonishing achievements in various fields such as the traffic control of vehicles in a wireless connected environment. In MARL, how to effectively decompose a global feedback into the relative contributions of individual agents belongs to one of the most fundamental problems. However, the volatility of the environment (e.g., the vehicle movement and wireless disturbance) could significantly shape the time-varying topological relationships among agents, thus making the Value Decomposition (VD) challenging. Therefore, in order to cope with this annoying volatility, it becomes imperative to design a dynamic VD framework. Hence, in this paper, we propose a novel Stochastic VMIX (SVMIX) methodology by embedding the dynamic topological features into the VD and incorporating the corresponding components into a multi-agent actor-critic architecture. In particular, the Stochastic Graph Neural Network (SGNN) is leveraged to effectively extract underlying dynamics embedded in topological features and improve the flexibility of VD against the environment volatility. Finally, the superiority of SVMIX is verified through extensive simulations.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Stochastic Graph Neural Network-Based Value Decomposition for Multi-Agent Reinforcement Learning in Urban Traffic Control


    Beteiligte:
    Xiao, Baidi (Autor:in) / Li, Rongpeng (Autor:in) / Wang, Fei (Autor:in) / Peng, Chenghui (Autor:in) / Wu, Jianjun (Autor:in) / Zhao, Zhifeng (Autor:in) / Zhang, Honggang (Autor:in)


    Erscheinungsdatum :

    2023-06-01


    Format / Umfang :

    2336455 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Reinforcement learning-based multi-agent system for network traffic signal control

    Arel, I. / Liu, C. / Urbanik, T. et al. | Tema Archiv | 2010



    Flow distribution area mixed traffic flow control method based on graph neural network reinforcement learning

    XU DONGWEI / LIU PEIWEN / QIU QINGWEI | Europäisches Patentamt | 2023

    Freier Zugriff

    Traffic Signal Control Based on Reinforcement Learning with Graph Convolutional Neural Nets

    Nishi, Tomoki / Otaki, Keisuke / Hayakawa, Keiichiro et al. | IEEE | 2018