This paper presents a deep reinforcement learning (DRL) approach to solve a reach-avoid problem that commonly arises in air defence systems. The focus of this paper is to improve the defender’s ability to pursue a more capable (faster) attacker that is trying to evade the defender while aiming for a target. We propose and analyze the resulting DRL strategy for scenarios with one and two pursuers against one evader and for two different types of aircraft, multirotor and fixed-wing, on the two-dimensional plane. During training, the pursuers face a faster evader that executes a saddle-point optimal strategy obtained by analytically solving the problem as a differential game (DG). We compare the win rate of the DRL policy with the win rate when pursuers use the DG strategy against the faster evader. Even though the DG strategy is optimal for aircraft with the same speed, it quickly deteriorates from the pursuer’s perspective when the evader is faster. In contrast, the results of the learned strategy show that the learned policy deteriorates slowly, which results in higher win rates in many situations with faster evaders when compared to the DG strategy.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Deep Reinforcement Learning Solution of Reach-Avoid Games with Superior Evader in the Context of Unmanned Aerial Systems


    Beteiligte:


    Erscheinungsdatum :

    06.06.2023


    Format / Umfang :

    1457895 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    A decentralized approach to pursuer-evader games with multiple superior evaders

    Mo Wei, / Genshe Chen, / Cruz, J.B. et al. | IEEE | 2006




    Multi-Pursuer Multi-Evader Pursuit-Evasion Games with Jamming Confrontation

    Mo Wei / Genshe Chen / Jose Cruz et al. | AIAA | 2007


    Controlling Tiltrotors Unmanned Aerial Vehicles (UAVs) with Deep Reinforcement Learning

    De Almeida, Aline Gabriel / Colombini, Esther Luna / Da Silva Simoes, Alexandre | IEEE | 2023