Unmanned aircraft systems (UASs) with autonomous maneuvering decision capabilities are expected to play a key role in future unmanned systems applications. While reinforcement learning has proven successful in solving UAS path planning problems in simple urban environments, it remains under-researched for some complex mountain environments. In this paper, the path planning of UAS swarm for the low-altitude rapid traverse in diverse environments is studied when facing the threats of complex terrain, radars and swarm failure. First, a UAS swarm radar detection probability is built up for evaluating the radar detection threat by a networked radar system, where the detection probability of a UAS swarm is equated to a single UAS with appropriate position and radar cross section named as the swarm virtual leader. Second, a reinforcement learning based path planning method is proposed to seek the optimal path for the swarm virtual leader which balances instantaneous reward, including detection probability and path constraints with terminal reward, including normal rate. Third, a formation optimization strategy is designed to further reduce the threat of radar detection through dynamically adjusting the formation geometry. Final, simulations in the complex environment have been carried out to evaluate the performance of the proposed method, where the path quality, task success rate and normal rate are counted as the performance indicators.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning-Based Low-Altitude Path Planning for UAS Swarm in Diverse Threat Environments


    Beteiligte:
    Jinwen Hu (Autor:in) / Liyuan Fan (Autor:in) / Yifei Lei (Autor:in) / Zhao Xu (Autor:in) / Wenxing Fu (Autor:in) / Gang Xu (Autor:in)


    Erscheinungsdatum :

    2023




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    UAV Swarm Path Planning with Reinforcement Learning for Field prospecting

    Puente-Castro, Alejandro / Rivero, Daniel / Pazos, Alejandro et al. | ArXiv | 2021

    Freier Zugriff

    Large-scale UAV swarm path planning based on mean-field reinforcement learning

    ZHANG, Yaozhong / DING, Meiyan / YUAN, Yao et al. | Elsevier | 2025

    Freier Zugriff



    Threat-aware Path Planning in Uncertain Urban Environments [Attached Video]

    Aoude, Georges S. / Luders, Brandon D. / Levine, Daniel S. et al. | DSpace@MIT | 2010

    Freier Zugriff