The invention discloses a poisoning attack method for multi-intersection signal lamp cooperative control based on strategy induction, and the method comprises the steps: training a multi-intersection signal lamp cooperative control model through a reinforcement learning deep Q learning algorithm (DQN), and respectively training a replacement model and an opponent strategy according to a strategy induction attack method; a traffic state is reconstructed by using a sample of an experience pool in a training process, so that a target agent adopts a specified action of an opponent strategy, and finally a Q value transmitted to an adjacent intersection in the training process is changed to cause malicious damage to a cooperative mechanism. According to the method, the disturbance traffic state can be calculated for the substitution model in the final stage of training and transmitted to the target agent, so that the target agent adopts the action specified by an attacker, and the vehicle passing efficiency of multiple intersections in a region is greatly reduced.

    本发明公开了一种基于策略诱导对多交叉口信号灯协同控制的中毒攻击方法,采用强化学习深度Q学习算法(DQN)训练多交叉口信号灯协同控制模型,根据策略诱导攻击方法分别训练替代模型和对手策略,利用训练过程中经验池的样本重构交通状态,使得目标智能体采取对手策略的指定动作,最终对训练过程中传递给邻接路口的Q值发生变化导致协同机制被恶意破坏。本发明能够在训练的最后阶段通过对替代模型计算扰动交通状态并传递给目标智能体,使得目标智能体采取攻击者指定的动作,大幅降低区域多交叉口的车辆通行效率。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Poison attack method for cooperative control of signal lamps at multiple intersections based on strategy induction


    Weitere Titelangaben:

    基于策略诱导对多交叉口信号灯协同控制的中毒攻击方法


    Beteiligte:
    XU DONGWEI (Autor:in) / WANG DA (Autor:in) / LI CHENGBIN (Autor:in)

    Erscheinungsdatum :

    2022-12-02


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    H04L TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION , Übertragung digitaler Information, z.B. Telegrafieverkehr / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Study of vehicle-road cooperative green wave traffic strategy for traffic signal intersections

    Wang, Jinwen / Gao, Xiujing / Duan, Huijie et al. | IEEE | 2022



    Fault-Tolerant Cooperative Driving at Signal-Free Intersections

    Pei, Huaxin / Zhang, Jiawei / Zhang, Yi et al. | IEEE | 2023



    Traffic Signal Coordination Control for Two Intersections Applying Cooperative Game Theory

    Zhang, J. / Gao, F. / Zhao, X. et al. | British Library Conference Proceedings | 2009