The traditional command operation depend on the ground station is difficult to adapt to the highly dynamic and uncertain UAV air combat environment. Previous researches on UAV autonomous maneuver decision have limitations due to oversimplified assumptions, large and complex calculations, and lack of flexibility. Aiming at the air combat scenario of Red and Blue UAV, a three-dimensional UAV air combat model based on Markov Decision Process (MDP) is established. We trained Red UAV with Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm to autonomously complete air combat missions. The performance is improved by scenario-transfer training and self-game training techniques. As the training scenario gradually transfers from simple to complex, the Red UAV continue to learn from previous experience steadily and improve the capabilities. The intelligence level is improved through self-game training. The simulation results present that the proposed maneuvering decision-making model and the training method can help the drone obtain effective decision-making strategies to get an advantage and defeat opponents in the confrontation.
Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning
Lect. Notes Electrical Eng.
International Conference on Autonomous Unmanned Systems ; 2021 ; Changsha, China September 24, 2021 - September 26, 2021
Proceedings of 2021 International Conference on Autonomous Unmanned Systems (ICAUS 2021) ; Kapitel : 257 ; 2616-2625
2022-03-18
10 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Autonomous Maneuver Strategy of UAV Wingman Air Combat Based on Hierarchical Reinforcement Learning
Springer Verlag | 2024
|Tube-based robust reinforcement learning for autonomous maneuver decision for UCAVs
Elsevier | 2024
|