Unmanned aerial vehicles (UAVs) play an vital role in modern air combats, where manned fighter (leader) can better perform air combat with the assisting of UAVs. The key technology for cooperative air warfare between UAVs and manned aircraft is UAV autonomous maneuver strategy. In this paper, an autonomous maneuver strategy of UAV wingman to assist leader in air combat is proposed. Firstly, based on the mission scenario and process of cooperative air combat, the UAV-assisted leader air combat model is established. Second, a two-level maneuver strategy method of UAV based on hierarchical reinforcement learning is designed, where the low-level agents control the game with enemy and manned fighter collaboration, and they are selected by a high-level agent. The reward functions of each agent are designed according to the relative situation to leader and enemy. Finally, the simulation experiment shows that the UAV can assist leader to strike enemy, proving the effectiveness of the proposed maneuver strategy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Autonomous Maneuver Strategy of UAV Wingman Air Combat Based on Hierarchical Reinforcement Learning


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Qu, Yi (editor) / Gu, Mancang (editor) / Niu, Yifeng (editor) / Fu, Wenxing (editor) / Hu, Jinwen (author) / Guo, Kun (author) / Xu, Zhao (author) / Xu, Gang (author)

    Conference:

    International Conference on Autonomous Unmanned Systems ; 2023 ; Nanjing, China September 09, 2023 - September 11, 2023



    Publication date :

    2024-04-26


    Size :

    10 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Loyal wingman task execution for future aerial combat: A hierarchical prior-based reinforcement learning approach

    ZHANG, Jiandong / WANG, Dinghan / YANG, Qiming et al. | Elsevier | 2024

    Free access

    Autonomous maneuver strategy of swarm air combat based on DDPG

    Wang, Luhe / Hu, Jinwen / Xu, Zhao et al. | Springer Verlag | 2021

    Free access


    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning

    Jin, Quan / Gao, Xianzhong / Guo, Zheng et al. | British Library Conference Proceedings | 2022


    Autonomous Maneuver Decision of UAV in Air Combat Based on Scenario-Transfer Deep Reinforcement Learning

    Jin, Quan / Gao, Xianzhong / Guo, Zheng et al. | Springer Verlag | 2022