The traditional command operation depend on the ground station is difficult to adapt to the highly dynamic and uncertain UAV air combat environment. Previous researches on UAV autonomous maneuver decision have limitations due to oversimplified assumptions, large and complex calculations, and lack of flexibility. Aiming at the air combat scenario of Red and Blue UAV, a three-dimensional UAV air combat model based on Markov Decision Process (MDP) is established. We trained Red UAV with Twin Delayed Deep Deterministic Policy Gradient (TD3) algorithm to autonomously complete air combat missions. The performance is improved by scenario-transfer training and self-game training techniques. As the training scenario gradually transfers from simple to complex, the Red UAV continue to learn from previous experience steadily and improve the capabilities. The intelligence level is improved through self-game training. The simulation results present that the proposed maneuvering decision-making model and the training method can help the drone obtain effective decision-making strategies to get an advantage and defeat opponents in the confrontation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning


    Weitere Titelangaben:

    Lect. Notes Electrical Eng.


    Beteiligte:
    Wu, Meiping (Herausgeber:in) / Niu, Yifeng (Herausgeber:in) / Gu, Mancang (Herausgeber:in) / Cheng, Jin (Herausgeber:in) / Jin, Quan (Autor:in) / Gao, Xianzhong (Autor:in) / Guo, Zheng (Autor:in) / Hou, Zhongxi (Autor:in)

    Kongress:

    International Conference on Autonomous Unmanned Systems ; 2021 ; Changsha, China September 24, 2021 - September 26, 2021



    Erscheinungsdatum :

    2022-03-18


    Format / Umfang :

    10 pages





    Medientyp :

    Aufsatz/Kapitel (Buch)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Deep Reinforcement Learning for Autonomous Aerobraking Maneuver Planning

    Falcone, Giusy / Putnam, Zachary R. | AIAA | 2022


    Deep Reinforcement Learning for Autonomous Aerobraking Maneuver Planning

    Falcone, Giusy / Putnam, Zachary R. | TIBKAT | 2022




    Tube-based robust reinforcement learning for autonomous maneuver decision for UCAVs

    WANG, Lixin / ZHENG, Sizhuang / PIAO, Haiyin et al. | Elsevier | 2024

    Freier Zugriff