Abstract Integrating low-altitude earth orbit (LEO) satellites (SATs) and unmanned aerial vehicles (UAVs) within a non-terrestrial network (NTN), we investigate the problem of forwarding packets between two faraway ground terminals through SAT and UAV relays using either radio-frequency (RF) or free-space optical (FSO) link. Towards maximizing the communication efficiency, the associations with orbiting SATs and the trajectories of UAVs should be optimized, which is challenging due to the time-varying network topology and a huge number of possible control actions. To overcome the difficulty, we lift this problem to multi-agent deep reinforcement learning with a novel action dimensionality reduction technique. Simulation results corroborate that our proposed SAT-UAV integrated scheme achieves 1.99x higher end-to-end sum throughput compared to a benchmark scheme with fixed ground relays. While improving the throughput, our proposed scheme also aims to reduce the UAV control energy, yielding 2.25x higher energy efficiency than a baseline method only maximizing the throughput. Lastly, thanks to utilizing hybrid FSO/RF links, the proposed scheme achieves up to 62.56x higher peak throughput and 21.09x higher worst-case throughput than the cases utilizing either RF or FSO links, highlighting the importance of co-designing SAT-UAV associations, UAV trajectories, and hybrid FSO/RF links in beyond-5 G NTNs.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Integrating LEO satellites and multi-UAV reinforcement learning for hybrid FSO/RF non-terrestrial networks


    Beteiligte:

    Erscheinungsdatum :

    2022-01-01


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Integrating LEO satellite and UAV relaying via reinforcement learning for non-terrestrial networks

    Lee, J.-H. (Ju-Hyung) / Park, J. (Jihong) / Bennis, M. (Mehdi) et al. | BASE | 2020

    Freier Zugriff

    Deep Reinforcement Learning-Based Routing for Space-Terrestrial Networks

    Tsai, Kai-Chu / Yao, Ting-Jui / Huang, Pin-Hao et al. | IEEE | 2022


    Adaptive Modulation Using Multi-Objective Reinforcement Learning for LEO Satellites

    Pasquevich, Felipe / Ramirez, Adrian Francisco / Ayarde, Juan Martin et al. | IEEE | 2021


    Propulsionless planar phasing of multiple satellites using deep reinforcement learning

    Smith, Brenton / Abay, Rasit / Abbey, Joshua et al. | Elsevier | 2020


    Silicon solar cells for satellites based terrestrial manufacturing

    Münzer, K.A. / Schlosser, R.E. / Hösselbarth, B. et al. | Tema Archiv | 2001