Aiming at the cooperative pursuit and confrontation task of multiple UAVs in the unknown escape UAV environment, a multi-UAVs cooperative pursuit and confrontation strategy based on P3C-MADDPG algorithm is proposed. First, in order to solve the problem of slow training speed and over estimation of Q value of Multi-Agent Deep Deterministic Policy Gradient (MADDPG) algorithm, In MADDPG algorithm, Prioritized Experience Replay (PER) based on tree structure storage and a parallel Critic network model with 3 threads are prioritized respectively, and the P3C-MADDPG algorithm is proposed. Then, based on the kinematics model of UAV, training elements such as state space, reward function combining sparse reward and guided reward, pursuit action space with different accelerations are designed. Finally, based on the above training elements, the P3C-MADDPG algorithm is used to generate the cooperative pursuit and confrontation strategy of multiple UAVs in the unknown escape UAV environment. Simulation experiments show that the P3C-MADDPG algorithm increases the training speed by 11.7% on average, and decreases the Q value by 6.06% on average. The generated multi-UAV cooperative pursuit and confrontation strategy can effectively avoid obstacles, and more intelligently realize the pursuit of unmanned aerial vehicles with unknown strategies.


    Access

    Download


    Export, share and cite



    Title :

    Research on multi-UAV cooperative pursuit and confrontation strategy based on P3C-MADDPG algorithm


    Contributors:


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown





    Pulse type track pursuit game method based on PRD-MADDPG algorithm

    ZHAO LIRAN / DANG CHAOHUI / TANG SHENGYONG et al. | European Patent Office | 2022

    Free access

    Research on autonomous formation of Multi-UAV based on MADDPG algorithm

    Zhang, Yaozhong / Wu, Zhuoran / Ma, Yunhong et al. | IEEE | 2022


    Fuzzy-MADDPG based Multi-UAV Cooperative Search in Network-limited Environments

    Zhao, Liang / Gao, Zihang / Hawbani, Ammar et al. | IEEE | 2024


    Design of a Multi-unmanned Aerial Vehicle Cooperative Hunting System Based on MADDPG

    Wang, Weifeng / Huang, Baiqiao / Wu, YanXia | Springer Verlag | 2024