Unmanned aerial vehicles (UAVs) have been extensively researched and deployed in both military and civilian applications due to their tiny size, low cost, and great ease. Although UAVs working together on complicated jobs can significantly increase productivity and reduce costs, they can cause major issues with path planning. In complex environments, the path planning problem, which is a multiconstraint combinatorial optimization problem and hard to settle, requires considering numerous constraints and limitations and generates the best paths for each UAV to accomplish group tasks. In this paper, we study the path planning problem for multiple UAVs and propose a reinforcement learning algorithm: PERDE-MADDPG based on prioritized experience replay (PER) and delayed update skills. First, we adopt a PER mechanism based on temporal difference (TD) error to enhance the efficiency of experience utilization and accelerate the convergence speed of the algorithm. Second, we use delayed updates in the process of updating network parameters to ensure stability in training multiple agents. Finally, we propose the PERDE-MADDPG algorithm based on PER and delayed update skills, which is evaluated against the MATD3, MADDPG, and SAC methods in simulation scenarios to confirm its efficacy.


    Access

    Download


    Export, share and cite



    Title :

    Prioritized Experience Replay–Based Path Planning Algorithm for Multiple UAVs


    Contributors:
    Chongde Ren (author) / Jinchao Chen (author) / Chenglie Du (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Path Planning for Multiple UAVs

    Tsourdos, Antonios / White, Brian / Shanmugavel, Madhavan | Wiley | 2010


    Multiple UAVs Path Planning Based on Optimized Water Drops Algorithm

    Shang, Yuanchun / Li, Yunqing / Zhao, Changchun | TIBKAT | 2022


    Multiple UAVs Path Planning Based on Optimized Water Drops Algorithm

    Shang, Yuanchun / Li, Yunqing / Zhao, Changchun | British Library Conference Proceedings | 2022


    Multiple UAVs Path Planning Based on Optimized Water Drops Algorithm

    Shang, Yuanchun / Li, Yunqing / Zhao, Changchun | Springer Verlag | 2022