Autonomous agile flight brings up fundamental challenges in robotics, such as coping with unreliable state estimation, reacting optimally to dynamically changing environments, and coupling perception and action in real time under severe resource constraints. In this paper, we consider these challenges in the context of autonomous, vision-based drone racing in dynamic environments. Our approach combines a convolutional neural network (CNN) with a state-of-the-art path-planning and control system. The CNN directly maps raw images into a robust representation in the form of a waypoint and desired speed. This information is then used by the planner to generate a short, minimum-jerk trajectory segment and corresponding motor commands to reach the desired goal. We demonstrate our method in autonomous agile flight scenarios, in which a vision-based quadrotor traverses drone-racing tracks with possibly moving gates. Our method does not require any explicit map of the environment and runs fully onboard. We extensively test the precision and robustness of the approach in simulation and in the physical world. We also evaluate our method against state-of-the-art navigation approaches and professional human drone pilots.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Deep Drone Racing: Learning Agile Flight in Dynamic Environments


    Beteiligte:

    Erscheinungsdatum :

    2018-10-05


    Anmerkungen:

    Kaufmann, Elia; Loquercio, Antonio; Ranftl, Rene; Dosovitskiy, Alexey; Koltun, Vladlen; Scaramuzza, Davide (2018). Deep Drone Racing: Learning Agile Flight in Dynamic Environments. In: Conference on Robotic Learning (CoRL), Zurich, 2018., Zurich, 1 October 2018 - 5 October 2018.



    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    DRONE FLIGHT PRACTICE AND RACING SYSTEM

    LEE JONG KYEONG / JUNG YONG BUM | Europäisches Patentamt | 2018

    Freier Zugriff

    DRONE FLIGHT PRACTICE AND RACING SYSTEM

    JEONG SEUNG HO / PARK JAE HONG | Europäisches Patentamt | 2019

    Freier Zugriff

    Drone Racing Frame

    RHEE JUN WHI | Europäisches Patentamt | 2020

    Freier Zugriff

    Learning Agile, Vision-Based Drone Flight: From Simulation to Reality

    Scaramuzza, Davide / Kaufmann, Elia | Springer Verlag | 2023


    DRONE RACING GAME SYSTEM

    OM SOUNG YOUNG / PARK JI HYUN / SEO YEON GON | Europäisches Patentamt | 2018

    Freier Zugriff