This paper proposes an improved multi-agent deep deterministic policy gradient algorithm called the equal-reward and action-enhanced multi-agent deep deterministic policy gradient (EA-MADDPG) algorithm to solve the guidance problem of multiple missiles cooperating to intercept a single intruding UAV in three-dimensional space. The key innovations of EA-MADDPG include the implementation of the action filter with additional reward functions, optimal replay buffer, and equal reward setting. The additional reward functions and the action filter are set to enhance the exploration performance of the missiles during training. The optimal replay buffer and the equal reward setting are implemented to improve the utilization efficiency of exploration experiences obtained through the action filter. In order to prevent over-learning from certain experiences, a special storage mechanism is established, where experiences obtained through the action filter are stored only in the optimal replay buffer, while normal experiences are stored in both the optimal replay buffer and normal replay buffer. Meanwhile, we gradually reduce the selection probability of the action filter and the sampling ratio of the optimal replay buffer. Finally, comparative experiments show that the algorithm enhances the agents’ exploration capabilities, allowing them to learn policies more quickly and stably, which enables multiple missiles to complete the interception task more rapidly and with a higher success rate.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Interception of a Single Intruding Unmanned Aerial Vehicle by Multiple Missiles Using the Novel EA-MADDPG Training Algorithm


    Beteiligte:
    He Cai (Autor:in) / Xingsheng Li (Autor:in) / Yibo Zhang (Autor:in) / Huanli Gao (Autor:in)


    Erscheinungsdatum :

    2024




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt





    Design of a Multi-unmanned Aerial Vehicle Cooperative Hunting System Based on MADDPG

    Wang, Weifeng / Huang, Baiqiao / Wu, YanXia | Springer Verlag | 2024


    Unmanned aerial vehicle cluster anti-interception collaborative strike guidance method

    LI YEPENG / LI YANJUN | Europäisches Patentamt | 2023

    Freier Zugriff


    AERIAL VEHICLE INTERCEPTION SYSTEM

    Europäisches Patentamt | 2023

    Freier Zugriff