This paper proposes an adversarial reinforcement learning (RL)-based traffic control strategy to improve the traffic efficiency of an integrated network with expressway and adjacent surface streets. The proposed adversarial RL integrates adversarial learning into a multi-agent RL model, namely the multi-agent advantage actor-critic (MA2C), so as to enhance the generalization of the control strategy against the mismatch between an offline-training environment and the real traffic process. In the adversarial RL, the RL model is trained to maximize the network throughput, while the adversarial network, which produces disturbances to observed traffic states, is trained based on the opposite reward of the RL model. The proposed control strategy is tested using the microscopic traffic simulation software, SUMO. To reproduce the difference between an offline-training environment and the real traffic process, two different traffic models in SUMO are used for offline-training and online-testing purposes, respectively. Simulation results demonstrate that the proposed approach performs better in reducing total time spent than the original MA2C approach, as well as a conventional feedback based controller.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Coordinated Control of Urban Expressway Integrating Adjacent Signalized Intersections Using Adversarial Network Based Reinforcement Learning Method


    Contributors:
    Han, Gengyue (author) / Han, Yu (author) / Wang, Hao (author) / Ruan, Tiancheng (author) / Li, Changze (author)


    Publication date :

    2024-02-01


    Size :

    5496040 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Signalized intersections

    Miller, A.J. | Engineering Index Backfile | 1968


    Physics-Informed Particle-Based Reinforcement Learning for Autonomy in Signalized Intersections

    Emamifar, Mehrnoosh / Ghoreishi, Seyede Fatemeh | Springer Verlag | 2024

    Free access


    Physics-Informed Particle-Based Reinforcement Learning for Autonomy in Signalized Intersections

    Emamifar, Mehrnoosh / Ghoreishi, Seyede Fatemeh | Springer Verlag | 2024

    Free access

    Eco-driving at signalized intersections: a parameterized reinforcement learning approach

    Jiang, Xia / Zhang, Jian / Li, Dan | Taylor & Francis Verlag | 2023