In the past few decades, drones have become lighter, with longer hang times, and exhibit more agile performance. To maximize their capabilities during flights in complex environments, researchers have proposed various model-based perception, planning, and control methods aimed at decomposing the problem into modules and collaboratively accomplishing the task in a sequential manner. However, in practical environments, it is extremely difficult to model both the drones and their environments, with very few existing model-based methods. In this study, we propose a novel model-free reinforcement-learning-based method that can learn the optimal planning and control policy from experienced flight data. During the training phase, the policy considers the complete state of the drones and environmental information as inputs. It then self-optimizes based on a predefined reward function. In practical implementations, the policy takes inputs from onboard and external sensors and outputs optimal control commands to low-level velocity controllers in an end-to-end manner. By capitalizing on this property, the planning and control policy can be improved without the need for an accurate system model and can drive drones to traverse complex environments at high speeds. The policy was trained and tested in a simulator, as well as in real-world flight experiments, demonstrating its practical applicability. The results show that this model-free method can learn to fly effectively and that it holds great potential to handle different tasks and environments.


    Access

    Download


    Export, share and cite



    Title :

    Model-Free Guidance Method for Drones in Complex Environments Using Direct Policy Exploration and Optimization


    Contributors:


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Drones for Space Exploration

    Medina, Fermin Navarro / Sande, Carlos Ulloa / Rey, Guillermo et al. | Springer Verlag | 2024


    Traffic surveillance and guidance drones

    KIM JIN YOU | European Patent Office | 2023

    Free access

    MULTIPLE ENERGY SOURCE GUIDANCE SYSTEM AND METHOD FOR DRONES

    CANTRELL ROBERT L / HIGH DONALD R / MCHALE BRIAN G et al. | European Patent Office | 2018

    Free access

    MULTIPLE ENERGY SOURCE GUIDANCE SYSTEM AND METHOD FOR DRONES

    CANTRELL ROBERT L / HIGH DONALD R / MCHALE BRIAN G et al. | European Patent Office | 2018

    Free access

    SPLINE TRAJECTORY PLANNING AND GUIDANCE FOR FIXED-WING DRONES

    Stephan, Johannes / Notter, Stefan / Pfeifle, Ole et al. | TIBKAT | 2020