With the development of intelligent airforce combat, deep reinforcement learning (DRL) has been widely applied in various combat systems. Among these systems, the hybrid system of the manned aerial vehicle (MAV) and unmanned aerial vehicle (UAV) with cooperative combat mode shows bright foreground. However, the heterogeneity and dynamics in the formation pose challenges to the cooperative combat planning algorithm. To this end, this paper proposes an intelligent MAV-UAV cooperative combat planning method based on discretized proximal policy optimization (PPO). A 5×5 rule-based action space is constructed based on the knowledge of air combat. The state space and the corresponding reward function are introduced to stably train the policy. In contrast to other continuous DRL methods and multi-agent DRL, the proposed method is easier to be reproduced and be trained, and the defined rule-based formation actions can be expanded to suit other scenes. The feasibility and effectiveness of the proposed planning method are validated by numerical experiments based on the XSimStudio.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An Intelligent MAV-UAV Cooperative Combat Planning Method Based on Deep Reinforcement Learning


    Contributors:
    Hu, Tingchun (author) / Li, Peng (author) / Yuan, Honghao (author) / Han, Yangnanbing (author) / Wang, Xiaohan (author) / Xie, Kunyu (author)


    Publication date :

    2022-12-09


    Size :

    1141201 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-UAV Cooperative Offensive Combat Intelligent Planning Based on Deep Reinforcement Learning

    LI Junsheng / YUE Longfei / ZUO Jialiang et al. | DOAJ | 2022

    Free access

    Deep Reinforcement Learning-based Intelligent Agent for Autonomous Air Combat

    Yoo, Jaewoong / Seong, Hyunki / Shim, David Hyunchul et al. | IEEE | 2022


    Research on intelligent combat decision making based on deep reinforcement learning

    Wang, Yao / Chen, Qijie / Ma, Haiqiang et al. | SPIE | 2023


    Cooperative Planning for an Unmanned Combat Aerial Vehicle Fleet Using Reinforcement Learning

    Yuksek, Burak / Umut Demirezen, Mustafa / Inalhan, Gokhan et al. | AIAA | 2021

    Free access