Reinforcement learning is of increasing importance in the field of robot control and simulation plays a~key role in this process. In the unmanned aerial vehicles (UAVs, drones), there is also an increase in the number of published scientific papers involving this approach. In this work, an autonomous drone control system was prepared to fly forward (according to its coordinates system) and pass the trees encountered in the forest based on the data from a rotating LiDAR sensor. The Proximal Policy Optimization (PPO) algorithm, an example of reinforcement learning (RL), was used to prepare it. A custom simulator in the Python language was developed for this purpose. The Gazebo environment, integrated with the Robot Operating System (ROS), was also used to test the resulting control algorithm. Finally, the prepared solution was implemented in the Nvidia Jetson Nano eGPU and verified in the real tests scenarios. During them, the drone successfully completed the set task and was able to repeatably avoid trees and fly through the forest.


    Access

    Download


    Export, share and cite



    Title :

    LiDAR-based drone navigation with reinforcement learning


    Contributors:

    Publication date :

    2023


    Remarks:

    Accepted for the XXVII Automation 2023 conference


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Reinforcement Learning for Navigation of Mobile Robot with LiDAR

    Kim, Inhwan / Nengroo, Sarvar Hussain / Har, Dongsoo | IEEE | 2021


    Deep Reinforcement Learning for Autonomous Drone Navigation in Cluttered Environments

    Chandrashekhar, A / Rawate, Amit / Dhanamathi, A. et al. | IEEE | 2024


    Deep Reinforcement Learning for Autonomous Drone Navigation in Cluttered Environments

    Solaimalai, Gautam / Prakash, Kode Jaya / S, Sampath Kumar et al. | IEEE | 2024


    Drone Navigation and Avoidance of Obstacles Through Deep Reinforcement Learning

    Cetin, Ender / Barrado, Cristina / Munoz, Guillem et al. | IEEE | 2019


    DRONE NAVIGATION DEVICE, DRONE NAVIGATION METHOD AND DRONE NAVIGATION PROGRAM

    SHIMIZU TATSUHIKO / KOSEKI MITSUAKI / FUJIWARA NOBORU | European Patent Office | 2018

    Free access