Unmanned aerial vehicles (UAVs) are important in reconnaissance missions because of their flexibility and convenience. Vitally, UAVs are capable of autonomous navigation, which means they can be used to plan safe paths to target positions in dangerous surroundings. Traditional path-planning algorithms do not perform well when the environmental state is dynamic and partially observable. It is difficult for a UAV to make the correct decision with incomplete information. In this study, we proposed a multi-UAV path planning algorithm based on multi-agent reinforcement learning which entails the adoption of centralized training–decentralized execution architecture to coordinate all the UAVs. Additionally, we introduced a hidden state of the recurrent neural network to utilize the historical observation information. To solve the multi-objective optimization problem, We designed a joint reward function to guide UAVs to learn optimal policies under the multiple constraints. The results demonstrate that by using our method, we were able to solve the problem of incomplete information and low efficiency caused by partial observations and sparse rewards in reinforcement learning, and we realized kdiff multi-UAV cooperative autonomous path planning in unknown environment.


    Access

    Download


    Export, share and cite



    Title :

    Multi-UAV Autonomous Path Planning in Reconnaissance Missions Considering Incomplete Information: A Reinforcement Learning Method


    Contributors:
    Yu Chen (author) / Qi Dong (author) / Xiaozhou Shang (author) / Zhenyu Wu (author) / Jinyu Wang (author)


    Publication date :

    2022




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    AUTONOMOUS UAV TEAM PLANNING FOR RECONNAISSANCE MISSIONS

    Szczerba, R. J. / Garrison, D. J. / Temullo, N. et al. | British Library Conference Proceedings | 2003


    UAV Autonomous Reconnaissance Route Planning Based on Deep Reinforcement Learning

    Xu, Tonghua / Wang, Nan / Lin, Hong et al. | IEEE | 2019



    Information-based Infrastructure in Support of Autonomous UAV Reconnaissance Missions

    Aljohani, Meshari / Mukkamala, Ravi / Olariu, Stephan | IEEE | 2024


    A Repeated Coverage Path Planning Method for Fixed-Wing UAV Conducting Persistent Reconnaissance Missions

    Huang, Junhua / Song, Ruijia / Yang, Zhou et al. | Springer Verlag | 2025