Unmanned aerial vehicles (UAVs) have been found significantly important in the air combats, where intelligent and swarms of UAVs will be able to tackle with the tasks of high complexity and dynamics. The key to empower the UAVs with such capability is the autonomous maneuver decision making. In this paper, an autonomous maneuver strategy of UAV swarms in beyond visual range air combat based on reinforcement learning is proposed. First, based on the process of air combat and the constraints of the swarm, the motion model of UAV and the multi-to-one air combat model are established. Second, a two-stage maneuver strategy based on air combat principles is designed which include inter-vehicle collaboration and target-vehicle confrontation. Then, a swarm air combat algorithm based on deep deterministic policy gradient strategy (DDPG) is proposed for online strategy training. Finally, the effectiveness of the proposed algorithm is validated by multi-scene simulations. The results show that the algorithm is suitable for UAV swarms of different scales.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Autonomous maneuver strategy of swarm air combat based on DDPG


    Weitere Titelangaben:

    Auton. Intell. Syst.


    Beteiligte:
    Wang, Luhe (Autor:in) / Hu, Jinwen (Autor:in) / Xu, Zhao (Autor:in) / Zhao, Chunhui (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2021-12-04




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch







    Autopilot Strategy Based on Improved DDPG Algorithm

    Zuo, Xiaochao / Li, Xiaoning / Tian, Zhewen | SAE Technical Papers | 2019


    Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm

    Li, Yue / Han, Wei / Zhong, Weiguo et al. | Springer Verlag | 2021


    Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm

    Li, Yue / Han, Wei / Zhong, Weiguo et al. | TIBKAT | 2022