Unmanned Combat Aerial Vehicles (UCAVs) play a significant role in modern military conflicts as they can perform intelligence, surveillance, reconnaissance, and target acquisition missions while carrying aircraft ordnance like missiles and bombs, and Anti-Tank Guided Missiles (ATGMs). However, the increased use of UCAVs has also led to more advanced anti-UCAV solutions in air defense. The paper proposes a deep reinforcement learning approach for generating online missile-evading maneuvers for combat aerial vehicles. The problem is made complicated by the missile's 8 Mach speed and the aircraft's limited 2.5 Mach speed. The system employs Twin Delayed Deep Deterministic Policy Gradient(TD3), one of the most known deep reinforcement learning algorithms, to train an agent to make real-time decisions on the best evasion tactics in a complex combat environment. A two-term reward function is used, with sparse rewards at terminal states and continuous rewards through the geometry of the combat. Aileron, rudder, and elevator controls are given directly to the algorithm to ensure all potential escape maneuvers are visible. The proposed methodology achieved a 59% success rate in extensive simulations, demonstrating its potential to enhance aerial vehicles' combat capabilities.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Missile Evasion Maneuver Generation with Model-free Deep Reinforcement Learning


    Contributors:


    Publication date :

    2023-06-07


    Size :

    3112018 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Ballistic Missile Maneuver Penetration Based on Reinforcement Learning

    Yang, Chaojie / Wu, Jiang / Liu, Guoqing et al. | IEEE | 2018


    Estimation-based missile threat detection and evasion maneuver for a low-altitude aircraft

    Tian, Zijiao / Danino, Meir / Bar-Shalom, Yaakov et al. | SPIE | 2023


    Optimal Missile Evasion

    R. L. Smith | NTIS | 1977


    Deep Reinforcement Learning for Autonomous Aerobraking Maneuver Planning

    Falcone, Giusy / Putnam, Zachary R. | AIAA | 2022


    Deep Reinforcement Learning for Autonomous Aerobraking Maneuver Planning

    Falcone, Giusy / Putnam, Zachary R. | TIBKAT | 2022