The utilization of unmanned aerial vehicle (UAV) for area coverage search is highly sought after in both military and civil domains, including but not limited to traversal search, mission reconnaissance, patrol detection, wildfire suppression control, remote sensing mapping, agricultural preservation, and accident search and rescue. This paper focuses on the problem of area coverage search for a single UAV in environments with the presence of unknown dynamic and static targets as well as hazardous areas. Here the UAV only knows the state of a small area and remembers the actions of the last time step without long-term memory. The objective is to design an adaptive and transferable algorithm for the UAV to find all static and dynamic targets with the minimum path repetition rate in the task area where both dangerous areas and completely unknown target information exist. Because the UAV has limited ability to observe all the map information, a partially observable Markov decision process is first formulated. Then we develop a coverage search algorithm based on Double Deep Q Network (DDQN) with the help of curriculum learning. By designing multiple constraint reward functions and employing path repetition rate and target batting average as evaluation metrics, the proposed algorithm facilitates the rapid adaptation of UAVs to diverse task environments. Simulation environment and algorithm models are finally established to illustrate the efficacy of the algorithm, which shows that the proposed algorithm with curriculum learning has rapid convergence, minimal path redundancy, high target acquisition rate, robust portability, and adaptability to variations in map area, hazard zones, and target quantity.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Research on UAV Coverage Search Based on DDQN in Unknown Environments


    Beteiligte:
    Deng, Gaofeng (Autor:in) / Yao, Xiaolan (Autor:in) / Wang, Bo (Autor:in) / He, Xiao (Autor:in) / Fei, Qing (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-11-17


    Format / Umfang :

    1546152 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    A Novel UAV Path Planning Method Based on Layered PER-DDQN

    Wang, Weixiang / Zhang, An / Bi, Wenhao et al. | Springer Verlag | 2022


    A Frontier Based Multi-Robot Approach for Coverage of Unknown Environments

    MUDDU, RAJA SANKAR DILEEP | BASE | 2015

    Freier Zugriff

    Economical self-adaptive cruise control method for electric vehicle based on multi-step DDQN

    XIE RONG / ZHAI CHUNJIE / CHEN CHUQIAO et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    UAV-Mounted RIS-Aided Mobile Edge Computing System: A DDQN-Based Optimization Approach

    Min Wu / Shibing Zhu / Changqing Li et al. | DOAJ | 2024

    Freier Zugriff