In this paper, we propose an end-to-end training method based on deep reinforcement learning for motion control problems in Unmanned-Aerial-Vehicle (UAV) active target tracking and autonomous obstacle avoidance. Proximal policy optimization (PPO) is employed as a deep reinforcement learning method to train artificial neural networks in an end-to-end manner using a continuous reward function. The proposed approach combines visual perception and deep reinforcement learning policy into an end-to-end decision control model. It takes RGB visual images observed by the UAV as input states, and outputs discrete control actions for UAV flight. Environment augmentation techniques and custom reward functions are utilized to enhance training efficiency and generalization capability. The training and validation are conducted in a simulation environment built using the Unreal Engine and Microsoft AirSim. The results of the simulation experiments demonstrate that the proposed approach can achieve autonomous tracking control of maneuvering targets for UAVs with good robustness and generalization. Moreover, for UAV autonomous obstacle avoidance tasks, the trained UAV based on this method can achieve fast and stable visual obstacle avoidance in unknown environments.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    End-to-end UAV Intelligent Training via Deep Reinforcement Learning


    Contributors:
    Liu, Xin (author) / Wang, Caizheng (author) / Guo, Qiuquan (author) / Yang, Jun (author)


    Publication date :

    2023-12-01


    Size :

    2019928 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Intelligent Formation Control using Deep Reinforcement Learning

    Johns, Rasmus Johns | BASE | 2018

    Free access


    ISUAM: Intelligent and Safe UAM with Deep Reinforcement Learning

    Garcia, Cristiano P. / Weigang, Li / Hirata, Nina S. T. et al. | IEEE | 2023


    Intelligent Robust Disturbance Rejection Control via Deep Reinforcement Learning

    Huang, Hanqiao / Xu, Feihong / Cheng, Haoyu et al. | Springer Verlag | 2022


    Intelligent Control of Manipulator Based on Deep Reinforcement Learning

    Zhou, Jiangtao / Zheng, Hua / Zhao, Dongzhu et al. | IEEE | 2021