The utilization of unmanned aerial vehicle (UAV) for area coverage search is highly sought after in both military and civil domains, including but not limited to traversal search, mission reconnaissance, patrol detection, wildfire suppression control, remote sensing mapping, agricultural preservation, and accident search and rescue. This paper focuses on the problem of area coverage search for a single UAV in environments with the presence of unknown dynamic and static targets as well as hazardous areas. Here the UAV only knows the state of a small area and remembers the actions of the last time step without long-term memory. The objective is to design an adaptive and transferable algorithm for the UAV to find all static and dynamic targets with the minimum path repetition rate in the task area where both dangerous areas and completely unknown target information exist. Because the UAV has limited ability to observe all the map information, a partially observable Markov decision process is first formulated. Then we develop a coverage search algorithm based on Double Deep Q Network (DDQN) with the help of curriculum learning. By designing multiple constraint reward functions and employing path repetition rate and target batting average as evaluation metrics, the proposed algorithm facilitates the rapid adaptation of UAVs to diverse task environments. Simulation environment and algorithm models are finally established to illustrate the efficacy of the algorithm, which shows that the proposed algorithm with curriculum learning has rapid convergence, minimal path redundancy, high target acquisition rate, robust portability, and adaptability to variations in map area, hazard zones, and target quantity.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Research on UAV Coverage Search Based on DDQN in Unknown Environments


    Contributors:
    Deng, Gaofeng (author) / Yao, Xiaolan (author) / Wang, Bo (author) / He, Xiao (author) / Fei, Qing (author)

    Published in:

    Publication date :

    2023-11-17


    Size :

    1546152 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    A Novel UAV Path Planning Method Based on Layered PER-DDQN

    Wang, Weixiang / Zhang, An / Bi, Wenhao et al. | Springer Verlag | 2022


    A Frontier Based Multi-Robot Approach for Coverage of Unknown Environments

    MUDDU, RAJA SANKAR DILEEP | BASE | 2015

    Free access

    Economical self-adaptive cruise control method for electric vehicle based on multi-step DDQN

    XIE RONG / ZHAI CHUNJIE / CHEN CHUQIAO et al. | European Patent Office | 2023

    Free access

    UAV-Mounted RIS-Aided Mobile Edge Computing System: A DDQN-Based Optimization Approach

    Min Wu / Shibing Zhu / Changqing Li et al. | DOAJ | 2024

    Free access