Abstract Providing a collision-free, safe and efficient optimal trajectory for unmanned aerial vehicles (UAVs) in an unknown dynamic environment is one of the most important issues for researchers. In this paper, a trajectory planning approach for UAV in unknown dynamic environment based on deep reinforcement learning (DRL) is proposed. This study models trajectory planning of UAV as a discrete-time, discrete-action problem, and then proposes an improved deep Q network (IDQN) algorithm to solve it. The IDQN algorithm adds the track angle information of UAV to the reward function to speed up the learning process, furthermore, it also improves the action selection strategy and learning rate setting. Besides, in simulation, the paper considers the trajectory constraints of UAV in order to make the obtained trajectory have better practical availability. Simulation results demonstrate the effectiveness of the IDQN algorithm to implement UAV trajectory planning with constraints in unknown dynamic environments. Meanwhile, comparison with the classical DQN (CDQN) algorithm is conducted to further explore the advantage of the method.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Trajectory Planning of UAV in Unknown Dynamic Environment with Deep Reinforcement Learning


    Contributors:
    Wang, Jia (author) / Wang, Weihong (author) / Wu, Qian (author)


    Publication date :

    2019-09-08


    Size :

    11 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Trajectory Planning of UAV in Unknown Dynamic Environment with Deep Reinforcement Learning

    Wang, Jia / Wang, Weihong / Wu, Qian | British Library Conference Proceedings | 2020


    Crossroad lighthouse trajectory planning method based on deep reinforcement learning

    LI BOQI / ZHANG WEIWEI / CHEN JIANG et al. | European Patent Office | 2024

    Free access

    Deep reinforcement learning-based path planning method for underwater gliders in unknown 3D marine environment

    Jiang, Nan / Zhao, Qinghai / Wang, Jirong | Taylor & Francis Verlag | 2025


    Trajectory Planning With Deep Reinforcement Learning in High-Level Action Spaces

    Williams, Kyle R. / Schlossman, Rachel / Whitten, Daniel et al. | IEEE | 2023


    Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning

    Du, Zhuo / Miao, Qiheng / Zong, Changfu | Springer Verlag | 2020