Federated learning (FL) provides an efficient distributed learning framework for computing-constrained Unmanned aerial vehicles (UAVs) swarms. However, due to the dynamic channel condition and limited resources in UAV swarm, the efficiency of FL requires to be further improved. In this paper, by leveraging the motion characteristics of UAVs, we propose an energy-efficient FL framework based on trajectory planning to train machine learning (ML) models. In the proposed framework, a two-level UAV swarm is established, consisting of a high-level UAV (H-UAV) and a group of low-level UAVs (L-UAVs). Considering the limited energy resources of the UAVs, our primary objective is to minimize the flight energy consumption of the H-UAV as it is much higher than the communication and computation energy consumption. To achieve this goal, we formulate the optimization problem jointly considering the adjustment of FL training parameters and the trajectory planning of H-UAV. Then, we reformulate the problem as a Markov decision process (MDP) and employ soft actor-critic (SAC) and deep deterministic policy gradient (DDPG) algorithms to tackle it. Simulation results show that the proposed approach and the proposed algorithms have good performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Deep Reinforcement Learning Approach for Federated Learning Optimization with UAV Trajectory Planning


    Contributors:
    Zhang, Chunyu (author) / Liu, Yiming (author) / Zhang, Zhi (author)


    Publication date :

    2023-09-05


    Size :

    1228311 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Crossroad lighthouse trajectory planning method based on deep reinforcement learning

    LI BOQI / ZHANG WEIWEI / CHEN JIANG et al. | European Patent Office | 2024

    Free access

    Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning

    Du, Zhuo / Miao, Qiheng / Zong, Changfu | Springer Verlag | 2020


    Trajectory Planning With Deep Reinforcement Learning in High-Level Action Spaces

    Williams, Kyle R. / Schlossman, Rachel / Whitten, Daniel et al. | IEEE | 2023


    A Trajectory Simulation Approach for Autonomous Vehicles Path Planning using Deep Reinforcement Learning

    de Oliveira Lima, Jean Phelipe / Oliveira, Raimundo Correa de / Costa, Cleinaldo de Almeida | BASE | 2020

    Free access

    Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

    Xiang Liu / Weizhi Zhong / Xin Wang et al. | DOAJ | 2024

    Free access