This paper investigates the resilient distributed secure output path following control problem of heterogeneous autonomous ground vehicles (AGVs) subject to cyber attacks based on reinforcement learning algorithm. Most existing results are subject to the same attack models for all communication channels, however multiple channels launched by different attackers are considered in this paper. First, a predictor-acknowledgement clock algorithm for each vehicle is proposed to judge whether the communication channel among neighboring vehicles is attacked or not by receiving or transmitting an acknowledgement. Then, a resilient distributed predictor is proposed to predict the pinning vehicle’s state for each vehicle. In addition, a resilient local control protocol consisting of the feedforward state provided by the predictor and the local feedback state of each vehicle is developed for the output path following problem, which is further converted to the optimal control problem by designing a discounted performance function. Discounted algebraic Riccati equations (AREs) are derived to address the optimal control problem. An off-policy reinforcement learning (RL) algorithm is put forward to learn the solution of discounted AREs online without any prior knowledge of vehicles’ dynamics. It is shown that the RL-based output path following control problem of AGVs imposed by cyber attacks can be achieved in an optimal manner. Finally, a numerical example is provided to verify the effectiveness of theoretical analysis.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Off-Policy Learning-Based Following Control of Cooperative Autonomous Vehicles Under Distributed Attacks


    Contributors:
    Xu, Yong (author) / Wu, Zheng-Guang (author) / Pan, Ya-Jun (author)


    Publication date :

    2023-05-01


    Size :

    1069665 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Secure Cooperative Path Following of Autonomous Surface Vehicles Under Cyber and Physical Attacks

    Liu, Zhao-Qing / Ge, Xiaohua / Han, Qing-Long et al. | IEEE | 2023



    Cooperative Control of Autonomous Ground Vehicles

    Akif, Mohammed / Geivald, Sebastian | BASE | 2021

    Free access


    Secure Pose Estimation for Autonomous Vehicles under Cyber Attacks

    Liu, Qipeng / Mo, Yilin / Mo, Xiaoyu et al. | IEEE | 2019