Unmanned aerial vehicles (UAVs) have been found significantly important in the air combats, where intelligent and swarms of UAVs will be able to tackle with the tasks of high complexity and dynamics. The key to empower the UAVs with such capability is the autonomous maneuver decision making. In this paper, an autonomous maneuver strategy of UAV swarms in beyond visual range air combat based on reinforcement learning is proposed. First, based on the process of air combat and the constraints of the swarm, the motion model of UAV and the multi-to-one air combat model are established. Second, a two-stage maneuver strategy based on air combat principles is designed which include inter-vehicle collaboration and target-vehicle confrontation. Then, a swarm air combat algorithm based on deep deterministic policy gradient strategy (DDPG) is proposed for online strategy training. Finally, the effectiveness of the proposed algorithm is validated by multi-scene simulations. The results show that the algorithm is suitable for UAV swarms of different scales.
Autonomous maneuver strategy of swarm air combat based on DDPG
Auton. Intell. Syst.
Autonomous Intelligent Systems ; 1 , 1
2021-12-04
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Autonomous Maneuver Strategy of UAV Wingman Air Combat Based on Hierarchical Reinforcement Learning
Springer Verlag | 2024
|Autopilot Strategy Based on Improved DDPG Algorithm
SAE Technical Papers | 2019
|Intelligent Decision-Making of MAV/UAV in Air Combat Based on DDPG Algorithm
Springer Verlag | 2021
|