This paper presents a deep reinforcement learning (DRL) approach to solve a reach-avoid problem that commonly arises in air defence systems. The focus of this paper is to improve the defender’s ability to pursue a more capable (faster) attacker that is trying to evade the defender while aiming for a target. We propose and analyze the resulting DRL strategy for scenarios with one and two pursuers against one evader and for two different types of aircraft, multirotor and fixed-wing, on the two-dimensional plane. During training, the pursuers face a faster evader that executes a saddle-point optimal strategy obtained by analytically solving the problem as a differential game (DG). We compare the win rate of the DRL policy with the win rate when pursuers use the DG strategy against the faster evader. Even though the DG strategy is optimal for aircraft with the same speed, it quickly deteriorates from the pursuer’s perspective when the evader is faster. In contrast, the results of the learned strategy show that the learned policy deteriorates slowly, which results in higher win rates in many situations with faster evaders when compared to the DG strategy.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Reinforcement Learning Solution of Reach-Avoid Games with Superior Evader in the Context of Unmanned Aerial Systems


    Contributors:


    Publication date :

    2023-06-06


    Size :

    1457895 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A decentralized approach to pursuer-evader games with multiple superior evaders

    Mo Wei, / Genshe Chen, / Cruz, J.B. et al. | IEEE | 2006




    Multi-Pursuer Multi-Evader Pursuit-Evasion Games with Jamming Confrontation

    Mo Wei / Genshe Chen / Jose Cruz et al. | AIAA | 2007


    Controlling Tiltrotors Unmanned Aerial Vehicles (UAVs) with Deep Reinforcement Learning

    De Almeida, Aline Gabriel / Colombini, Esther Luna / Da Silva Simoes, Alexandre | IEEE | 2023