Reinforcement learning (RL) has been proven to enable the automation of tasks involving complex sequential decision-making. The simulation to reality (sim2real) gap, however, poses a major challenge in most engineering applications. In this work, we propose a learning approach combining RL-based navigation and collision avoidance scheme with low-level advanced control to bridge the sim2real gap for unmanned aerial vehicle (UAV) applications. The proposed approach puts the RL agent at the top of the control hierarchy to focus on behavioral intelligence. We demonstrate the transferability of the RL policy trained in simulation to a real UAV without randomization of the system's dynamic parameters. The direct transfer is enabled by: 1) the use of deep neural networks with the modified relay feedback test (DNN-MRFT) to identify the parameters of the UAV; and 2) formulating a reward function to penalize excessive actor actions. Particularly, the RL agent generates high-level velocity actions to achieve the sought task, while the low-level controller minimizes any unwanted disturbances and model discrepancies. The proposed approach has been tested and validated using computer simulations and real-world experiments. The real-world experimental results demonstrated the agent's capability to achieve the navigation task with a $90 \%$ success rate.


    Access

    Download


    Export, share and cite



    Title :

    Learning-Based Navigation and Collision Avoidance Through Reinforcement for UAVs


    Contributors:


    Publication date :

    2024-06-01


    Size :

    14248219 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    ICAS2014_0892: A REINFORCEMENT LEARNING BASED UAVS AIR COLLISION AVOIDANCE

    Yang, J. / Yin, D. / Xie, H. | British Library Conference Proceedings | 2014


    DECENTRALIZED COLLISION AVOIDANCE FOR UAVS

    HALL ROBERT J | European Patent Office | 2022

    Free access

    DECENTRALIZED COLLISION AVOIDANCE FOR UAVS

    HALL ROBERT J | European Patent Office | 2020

    Free access

    Decentralized collision avoidance for UAVs

    HALL ROBERT J | European Patent Office | 2021

    Free access