In this paper, a UAV-assisted wireless powered communication system for IoT network is studied. Specifically, the UAV performs as base station (BS) to collect the sensory information of the IoT devices as well as to broadcast energy signals to charge them. Considering the devices' limited data storage capacity and battery life, we propose a multi-objective optimization problem that aims to minimize the average data buffer length, maximize the residual battery level of the system and avoid data overflow and running out of battery of devices. Since the services requirements of IoT devices are dynamic and uncertain and the system can not be full observed by the UAV, it is challenging for UAV to achieve trajectory planning. In this regard, a deep Q network (DQN) is applied for UAV's flight control. Simulation results indicate that the DQN-based algorithm provides an efficient UAV's flight control policy for the proposed optimization problem.


    Access

    Download


    Export, share and cite



    Title :

    Trajectory Planning of UAV in Wireless Powered IoT System Based on Deep Reinforcement Learning


    Contributors:
    Zhang, J (author) / Yu, Y (author) / Wang, Z (author) / Ao, S (author) / Tang, J (author) / Zhang, X (author) / Wong, KK (author)

    Publication date :

    2020-11-09


    Remarks:

    In: Proceedings of the 2020 IEEE/CIC International Conference on Communications in China (ICCC). (pp. pp. 645-650). IEEE: Chongqing, China. (2020)


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Deep Reinforcement Learning-Based 3D Trajectory Planning for Cellular Connected UAV

    Xiang Liu / Weizhi Zhong / Xin Wang et al. | DOAJ | 2024

    Free access

    Trajectory Planning for Automated Parking Systems Using Deep Reinforcement Learning

    Du, Zhuo / Miao, Qiheng / Zong, Changfu | Springer Verlag | 2020


    Trajectory Planning With Deep Reinforcement Learning in High-Level Action Spaces

    Williams, Kyle R. / Schlossman, Rachel / Whitten, Daniel et al. | IEEE | 2023


    The Trajectory Planning Method for UAV in Large Airspace Based on Deep Reinforcement Learning

    Hu, Weijun / Quan, Jiale / Ma, Xianlong et al. | Springer Verlag | 2022


    DEEP REINFORCEMENT LEARNING BASED AGGRESSIVE FLIGHT TRAJECTORY TRACKER

    Shadeed, Omar / Hasanzade, Mehmet / Koyuncu, Emre | TIBKAT | 2021