Unmanned aerial vehicles (UAV) specifically drones have been used for surveillance, shipping and delivery, wildlife monitoring, disaster management etc. The increase on the number of drones in the airspace worldwide will lead necessarily to full autonomous drones. Given the expected huge number of drones, if they were operated by human pilots, the possibility to collide with each other could be too high. In this paper, deep reinforcement learning (DRL) architecture is proposed to make drones behave autonomously inside a suburb neighborhood environment. The environment in the simulator has plenty of obstacles such as trees, cables, parked cars and houses. In addition, there are also another drones, acting as moving obstacles, inside the environment while the learner drone has a goal to achieve. In this way the drone can be trained to detect stationary and moving obstacles inside the neighborhood and so the drones can be used safely in a public area in the future. The drone has a front camera and it can capture continuously depth images. Every depth image is part of the state used in DRL architecture. Also, another part of the state is the distance to the geo-fence (a virtual barrier on the environment) which is added as a scalar value. The agent will be rewarded negatively when it tries to overpass the geo-fence limits. In addition, angle to goal and elevation angle between the goal and the drone will be used as information to be added to the state. It is considered that these scalar values will improve the DRL performance and also the reward obtained. The drone is trained using Q-Network and its convergence and final reward are evaluated. The states containing image and several scalars are processed by a neural network that joints the two state parts into a unique flow. This neural network is named as Joint Neural Network (JNN) [1]. The training and test results show that the agent can successfully learn to avoid any obstacle in the environment. The results for three scenarios are very promising and the learner drone reaches the destination with a success rate 100% in first two tests and with a success rate 98% in the last test, this one with a total of three drones.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Drone Navigation and Avoidance of Obstacles Through Deep Reinforcement Learning


    Contributors:


    Publication date :

    2019-09-01


    Size :

    5085564 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Deep Reinforcement Learning for Drone Delivery

    Guillem Muñoz / Cristina Barrado / Ender Çetin et al. | DOAJ | 2019

    Free access

    Drone deep reinforcement learning: A review

    Azar, Ahmad Taher / Koubaa, Anis / Ali Mohamed, Nada et al. | BASE | 2021

    Free access

    Vision-guided Collision Avoidance Through Deep Reinforcement Learning

    Song, Sirui / Zhang, Yuanhang / Qin, Xi et al. | IEEE | 2021


    NAVIGATION CONTROL FOR OBSTACLES AVOIDANCE IN AERIAL NAVIGATION SYSTEM

    CERNAZANU-GLAVAN COSMIN / PESCARU DAN ALEXANDRU / GUI VASILE et al. | European Patent Office | 2024

    Free access

    Learning-Based Navigation and Collision Avoidance Through Reinforcement for UAVs

    Azzam, Rana / Chehadeh, Mohamad / Hay, Oussama Abdul et al. | IEEE | 2024

    Free access