Multi-Agent Reinforcement Learning (MARL) has reached astonishing achievements in various fields such as the traffic control of vehicles in a wireless connected environment. In MARL, how to effectively decompose a global feedback into the relative contributions of individual agents belongs to one of the most fundamental problems. However, the volatility of the environment (e.g., the vehicle movement and wireless disturbance) could significantly shape the time-varying topological relationships among agents, thus making the Value Decomposition (VD) challenging. Therefore, in order to cope with this annoying volatility, it becomes imperative to design a dynamic VD framework. Hence, in this paper, we propose a novel Stochastic VMIX (SVMIX) methodology by embedding the dynamic topological features into the VD and incorporating the corresponding components into a multi-agent actor-critic architecture. In particular, the Stochastic Graph Neural Network (SGNN) is leveraged to effectively extract underlying dynamics embedded in topological features and improve the flexibility of VD against the environment volatility. Finally, the superiority of SVMIX is verified through extensive simulations.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Stochastic Graph Neural Network-Based Value Decomposition for Multi-Agent Reinforcement Learning in Urban Traffic Control


    Contributors:
    Xiao, Baidi (author) / Li, Rongpeng (author) / Wang, Fei (author) / Peng, Chenghui (author) / Wu, Jianjun (author) / Zhao, Zhifeng (author) / Zhang, Honggang (author)


    Publication date :

    2023-06-01


    Size :

    2336455 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English





    Reinforcement learning-based multi-agent system for network traffic signal control

    Arel, I. / Liu, C. / Urbanik, T. et al. | Tema Archive | 2010


    Hierarchical control for stochastic network traffic with reinforcement learning

    Su, Z.C. / Chow, Andy H.F. / Fang, C.L. et al. | Elsevier | 2022


    Flow distribution area mixed traffic flow control method based on graph neural network reinforcement learning

    XU DONGWEI / LIU PEIWEN / QIU QINGWEI | European Patent Office | 2023

    Free access