Drones are rapidly increasing their activity in the airspace worldwide. This expected growth of the number of drones makes human-based traffic management prohibitive. Avionics systems able to sense-and-avoid obstacles and specially visual flight rules (VFR) traffic are under research. Moreover, to overcome loss-link contingencies, drones have to be able to act autonomously. In this paper we present a drone concept with a full level of autonomy based on Deep Reinforcement Learning (DRL). From the first flight until the accomplishment of its final mission, the drone has no need for a pilot. The only human intervention is the engineer programming the artificial intelligence algorithm used to train and then to control the drone. In this paper we present the preliminary results for an environment which is a realistic flight simulator, and an agent that is a quad-copter drone able to execute 3 actions. The inputs of the agent are the current state and the accumulated reward. Experiments include self-learning periods up to 3 days, followed by one hundred full-autonomous flight tests. Three different DRL algorithms were used to obtain the training models, based in Q-learning reinforcement learning. Results are very promising, with around an 80 percent of test flights reaching the target. In comparison with the results of a human pilot, acting in the same simulated environment and using the same three actions, the DRL methods demonstrated unequal results, depending on the learning algorithm used. We applied some enhancements in the training, with the creation of checkpoints of the training model every time a better solution is found. In a near future we expect to achieve results similar to the performance of a human pilot to support the idea of full-autonomous drones through DRL methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Self-training by Reinforcement Learning for Full-autonomous Drones of the Future*


    Beteiligte:
    Kersandt, Kjell (Autor:in) / Munoz, Guillem (Autor:in) / Barrado, Cristina (Autor:in)


    Erscheinungsdatum :

    01.09.2018


    Format / Umfang :

    2052470 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Drones Chasing Drones: Reinforcement Learning and Deep Search Area Proposal

    Moulay A. Akhloufi / Sebastien Arola / Alexandre Bonnet | DOAJ | 2019

    Freier Zugriff

    Path Planning for Autonomous Drones: Challenges and Future Directions

    Gopi Gugan / Anwar Haque | DOAJ | 2023

    Freier Zugriff

    Explainability of Deep Reinforcement Learning Method with Drones

    Cetin, Ender / Barrado, Cristina / Pastor, Enric | IEEE | 2023


    Charging system for autonomous drones

    SMITH TYLER / MIAN SAMI / WESTGARD KEVIN et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    AUTONOMOUS DOCKING STATION FOR DRONES

    STRAUS ITAI / TAL YITZHAK | Europäisches Patentamt | 2017

    Freier Zugriff