Driven by advances in artificial intelligence, deep reinforcement learning (DRL) has made remarkable strides in adaptive traffic signal control (ATSC), empowering improved handling of fluctuating traffic volumes and congestion. However, in most existing studies, trained agents exhibit poor transferability in scenarios with varying vehicle turning ratios, and the switching rules for the signal stage sequence do not align with the actual traffic demands. To address these issues, this paper presents action masking based proximal policy optimization with the dual-ring phase structure (AMPPO-DR), a novel ATSC model based on DRL that can simultaneously optimize the stage sequence and duration. Specifically, we consider the correlation between states and actions and utilize intersection channelization to predict vehicle turning directions. Moreover, we define the action as selecting the next green stage and establish variable-stage-sequence constraint rules on the basis of the dual-ring phase structure. To satisfy the constraints on the stage sequence, we propose the AMPPO algorithm, which dynamically adjusts the policy network outputs to mask invalid stages in real time. The simulation experiments demonstrate that the proposed method can effectively adapt to changing turning flows, enabling flexible and rational stage switching and ultimately increasing traffic efficiency.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Action Masking-Based Proximal Policy Optimization With the Dual-Ring Phase Structure for Adaptive Traffic Signal Control


    Beteiligte:
    Fan, Shuying (Autor:in) / Lu, Kai (Autor:in) / Wang, Yinhai (Autor:in) / Tian, Xin (Autor:in) / Zhang, Minxue (Autor:in)


    Erscheinungsdatum :

    01.02.2025


    Format / Umfang :

    3159263 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Improving traffic signal control operations using proximal policy optimization

    Huang, Liben / Qu, Xiaohui | Wiley | 2023

    Freier Zugriff

    Improving traffic signal control operations using proximal policy optimization

    Liben Huang / Xiaohui Qu | DOAJ | 2023

    Freier Zugriff

    Mixed-Autonomy Traffic Control with Proximal Policy Optimization

    Wei, Haoran / Liu, Xuanzhang / Mashayekhy, Lena et al. | IEEE | 2019