In this paper, we design a navigation policy for multiple unmanned aerial vehicles (UAVs) where mobile base stations (BSs) are deployed to improve the data freshness and connectivity to the Internet of Things (IoT) devices. First, we formulate an energy-efficient trajectory optimization problem in which the objective is to maximize the energy efficiency by optimizing the UAV-BS trajectory policy. We also incorporate different contextual information such as energy and age of information (AoI) constraints to ensure the data freshness at the ground BS. Second, we propose an agile deep reinforcement learning with experience replay model to solve the formulated problem concerning the contextual constraints for the UAV-BS navigation. Moreover, the proposed approach is well-suited for solving the problem, since the state space of the problem is extremely large and finding the best trajectory policy with useful contextual features is too complex for the UAV-BSs. By applying the proposed trained model, an effective real-time trajectory policy for the UAV-BSs captures the observable network states over time. Finally, the simulation results illustrate the proposed approach is 3.6% and 3.13% more energy efficient than those of the greedy and baseline deep Q Network (DQN) approaches.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Data Freshness and Energy-Efficient UAV Navigation Optimization: A Deep Reinforcement Learning Approach


    Beteiligte:


    Erscheinungsdatum :

    2021-09-01


    Format / Umfang :

    1771239 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Automatic Navigation Using Deep Reinforcement Learning

    BALAKRISHNAN KAUSHIK / NARAYANAN PRAVEEN / LAKEHAL-AYAT MOHSEN | Europäisches Patentamt | 2019

    Freier Zugriff

    Automatic navigation using deep reinforcement learning

    BALAKRISHNAN KAUSHIK / NARAYANAN PRAVEEN / LAKEHAL-AYAT MOHSEN | Europäisches Patentamt | 2023

    Freier Zugriff


    Autonomous vehicle navigation with deep reinforcement learning

    Cabañeros López, Àlex | BASE | 2019

    Freier Zugriff

    Deep Reinforcement Learning for Mobile Robot Navigation

    Gromniak, Martin / Stenzel, Jonas | BASE | 2019

    Freier Zugriff