Multi-agent reinforcement learning (MARL) based methods for adaptive traffic signal control (ATSC) have shown promising potentials to solve the heavy traffic problems. The existing MARL methods adopt centralized or distributed strategies. The former only models the environment as an agent and suffers from the exponential growth of action and state space. The latter extends the independent reinforcement learning methods, such as DQN, to multiple interactions directly or propagates information, such as state and policy, without taking their qualities into account. In this paper, we propose a multi-agent transfer reinforcement learning method to enhance the performance of MARL for ATSC, which is termed as multi-agent transfer soft actor-critic with the multi-view encoder (MT-SAC). The MT-SAC combines centralized and distributed strategies. In MT-SAC, we propose a multi-view state encoder and a transfer learning paradigm with guidance. The encoder processes input states from multiple perspectives and uses an attention mechanism to weigh the neighborhood information. While the paradigm enables the agents to handle different conditions for improving generalization abilities by transfer learning. Experimental studies on different scale road networks show that the MT-SAC outperforms the state-of-the-art algorithms and makes the traffic signal controllers more collaborative and robust.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Multi-Agent Transfer Reinforcement Learning With Multi-View Encoder for Adaptive Traffic Signal Control


    Beteiligte:
    Ge, Hongwei (Autor:in) / Gao, Dongwan (Autor:in) / Sun, Liang (Autor:in) / Hou, Yaqing (Autor:in) / Yu, Chao (Autor:in) / Wang, Yuxin (Autor:in) / Tan, Guozhen (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-08-01


    Format / Umfang :

    15488080 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Adaptive traffic signal control method based on multi-agent reinforcement learning

    ZHANG CHENGWEI / JIN SHAN / ZHENG KANGJIE | Europäisches Patentamt | 2021

    Freier Zugriff

    Multi-agent reinforcement learning method for fair adaptive traffic signal control

    ZHANG CHENGWEI / FANG WANQING / ZHAO XINTIAN | Europäisches Patentamt | 2023

    Freier Zugriff

    MULTI-AGENT REINFORCEMENT LEARNING FOR INTEGRATED AND NETWORKED ADAPTIVE TRAFFIC SIGNAL CONTROL

    EL-TANTAWY SAMAH / ABDULHAI BAHER | Europäisches Patentamt | 2018

    Freier Zugriff

    Multi-agent reinforcement learning for integrated and networked adaptive traffic signal control

    EL-TANTAWY SAMAH / ABDULHAI BAHER | Europäisches Patentamt | 2017

    Freier Zugriff

    Traffic light signal control method based on multi-agent reinforcement learning

    ZHAO SHENGJIE / DENG HAO / CHEN ZHI | Europäisches Patentamt | 2022

    Freier Zugriff