Currently, the complex traffic environment challenges the fast and accurate response of a connected autonomous vehicle (CAV). More importantly, it is difficult for different CAVs to collaborate and share knowledge. To remedy that, this paper proposes a selective federated reinforcement learning (SFRL) strategy to achieve online knowledge aggregation strategy to improve the accuracy and environmental adaptability of the autonomous driving model. First, we propose a federated reinforcement learning framework that allows participants to use the knowledge of other CAVs to make corresponding actions, thereby realizing online knowledge transfer and aggregation. Second, we use reinforcement learning to train local driving models of CAVs to cope with collision avoidance tasks. Third, considering the efficiency of federated learning (FL) and the additional communication overhead it brings, we propose a CAVs selection strategy before uploading local models. When selecting CAVs, we consider the reputation of CAVs, the quality of local models, and time overhead, so as to select as many high-quality users as possible while considering resources and time constraints. With above strategic processes, our framework can aggregate and reuse the knowledge learned by CAVs traveling in different environments to assist in driving decisions. Extensive simulation results validate that our proposal can improve model accuracy and learning efficiency while reducing communication overhead.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Selective Federated Reinforcement Learning Strategy for Autonomous Driving


    Contributors:
    Fu, Yuchuan (author) / Li, Changle (author) / Yu, F. Richard (author) / Luan, Tom H. (author) / Zhang, Yao (author)


    Publication date :

    2023-02-01


    Size :

    2480548 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Deep Federated Learning for Autonomous Driving

    Nguyen, Anh / Do, Tuong / Tran, Minh et al. | IEEE | 2022



    Privacy-Preserved Federated Learning for Autonomous Driving

    Li, Yijing / Tao, Xiaofeng / Zhang, Xuefei et al. | IEEE | 2022


    Autonomous Driving with Deep Reinforcement Learning

    Zhu, Yuhua / Technische Universität Dresden | SLUB | 2023


    A Fair and Efficient Federated Learning Algorithm for Autonomous Driving

    Tang, Xinlong / Zhang, Jiayi / Fu, Yuchuan et al. | IEEE | 2023