Federated learning (FL) provides an efficient distributed learning framework for computing-constrained Unmanned aerial vehicles (UAVs) swarms. However, due to the dynamic channel condition and limited resources in UAV swarm, the efficiency of FL requires to be further improved. In this paper, by leveraging the motion characteristics of UAVs, we propose an energy-efficient FL framework based on trajectory planning to train machine learning (ML) models. In the proposed framework, a two-level UAV swarm is established, consisting of a high-level UAV (H-UAV) and a group of low-level UAVs (L-UAVs). Considering the limited energy resources of the UAVs, our primary objective is to minimize the flight energy consumption of the H-UAV as it is much higher than the communication and computation energy consumption. To achieve this goal, we formulate the optimization problem jointly considering the adjustment of FL training parameters and the trajectory planning of H-UAV. Then, we reformulate the problem as a Markov decision process (MDP) and employ soft actor-critic (SAC) and deep deterministic policy gradient (DDPG) algorithms to tackle it. Simulation results show that the proposed approach and the proposed algorithms have good performance.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Deep Reinforcement Learning Approach for Federated Learning Optimization with UAV Trajectory Planning


    Beteiligte:
    Zhang, Chunyu (Autor:in) / Liu, Yiming (Autor:in) / Zhang, Zhi (Autor:in)


    Erscheinungsdatum :

    2023-09-05


    Format / Umfang :

    1228311 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning

    Du, Zhuo / Miao, Qiheng / Zong, Changfu | Springer Verlag | 2020


    Trajectory Planning With Deep Reinforcement Learning in High-Level Action Spaces

    Williams, Kyle R. / Schlossman, Rachel / Whitten, Daniel et al. | IEEE | 2023


    A Trajectory Simulation Approach for Autonomous Vehicles Path Planning using Deep Reinforcement Learning

    de Oliveira Lima, Jean Phelipe / Oliveira, Raimundo Correa de / Costa, Cleinaldo de Almeida | BASE | 2020

    Freier Zugriff

    Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

    Xiang Liu / Weizhi Zhong / Xin Wang et al. | DOAJ | 2024

    Freier Zugriff

    Trajectory Planning of UAV in Unknown Dynamic Environment with Deep Reinforcement Learning

    Wang, Jia / Wang, Weihong / Wu, Qian | Springer Verlag | 2019