To reduce the outage of the connection between unmanned aerial vehicles (UAVs) and cellular networks in complex real-time channel state, and reduce the energy consumption of UAV during flight mission, an online trajectory optimization scheme of UAV based on outage probability knowledge map reconstruction is proposed. The outage probability knowledge map is a database that simulates the connection between UAV and the cellular network during real hovers. The UAV first samples sparsely from the target area and calculates the outage probability of the sampling point, and then uses the Kriging algorithm to reconstruct the outage probability knowledge map. Based on the reconstructed outage probability knowledge map, with the goal of minimizing the energy consumption of UAV task execution, the UAV trajectory optimization problem is established, and a trajectory optimization algorithm based on deep reinforcement learning (DRL) is proposed to solve it. Numerical results show that the proposed online trajectory optimization scheme based on outage probability knowledge map can obtain great returns in terms of maintaining connectivity, reducing task completion time and energy consumption.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Reinforcement Learning Aided Online Trajectory Optimization of Cellular-Connected UAVs with Offline Map Reconstruction


    Contributors:
    Hao, Qing (author) / Zhao, Haitao (author) / Huang, Hao (author) / Gui, Guan (author) / Ohtsuki, Tomoaki (author) / Adachi, Fumiyuki (author)


    Publication date :

    2023-06-01


    Size :

    1467994 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Deep Reinforcement Learning for Trajectory Generation and Optimisation of UAVs

    Akhtar, Mishma / Maqsood, Adnan / Verbeke, Mathias | IEEE | 2023


    Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

    Xiang Liu / Weizhi Zhong / Xin Wang et al. | DOAJ | 2024

    Free access

    Learning-Aided Online Task Offloading for UAVs-Aided IoT Systems

    Zhu, Junge / Huang, Xi / Tang, Yinxu et al. | IEEE | 2019


    Collaborative Trajectory Optimization for Outage-aware Cellular-Enabled UAVs

    Chapnevis, Amirahmad / Guvenc, Ismail / Njilla, Laurent et al. | IEEE | 2021


    Intersection vehicle trajectory optimization method and system based on offline reinforcement learning

    ZHANG JIAN / SHI XIAOYU / JIANG XIA et al. | European Patent Office | 2023

    Free access