With the growing traffic congestion problem, more and more deep reinforcement learning (DRL) methods have been applied in traffic signals control(TSC). But researches show that DRL is very fragile with abnormal data. In this paper, special traffic state abnormal data (TSAD) are simulated, based on which the robustness of DRL is analyzed and improved for traffic signals control. Firstly, the perturbation noise is generated based on the Discrete Carlin&Wagner attack, which is then added to the normal data to simulate the TSAD. Secondly, under different type of TSAD, the robustness of DRL models for traffic signals control is explored, which are demonstrated to have certain vulnerability, especially with high traffic flows. Finally, induction model based on reward detection (IMR) and mask the activation values of decision neurons (MVN) are proposed to effectively improve the robustness of DRL models for traffic signals control.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Robustness Analysis of Discrete State-Based Reinforcement Learning Models in Traffic Signal Control


    Beteiligte:
    Xu, Dongwei (Autor:in) / Li, Chengbin (Autor:in) / Wang, Da (Autor:in) / Gao, Guangyan (Autor:in)


    Erscheinungsdatum :

    2023-02-01


    Format / Umfang :

    3436697 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Deep Learning vs. Discrete Reinforcement Learning for Adaptive Traffic Signal Control

    Shabestary, Soheil Mohamad Alizadeh / Abdulhai, Baher | IEEE | 2018


    Deep Reinforcement Learning-based Traffic Signal Control

    Ruan, Junyun / Tang, Jinzhuo / Gao, Ge et al. | IEEE | 2023


    Traffic signal control method based on reinforcement learning

    LONG SHUI / YU JIADI | Europäisches Patentamt | 2023

    Freier Zugriff