In this paper, we discuss the co-optimized performance of multi-reconfigurable intelligent surface (RIS)-assisted integrated satellite-unmanned aerial vehicle-terrestrial network (IS-UAV-TN), where the multiple vehicle users are applied to the network under consideration. The performance optimization of IS-UAV-TNs faces two major challenges: one is the obstacles in the transmission path and the other is the highly dynamic communication environment caused by the UAV movement for the multiple ground vehicle users. To tackle these above issues efficiently, we will install RIS on the UAV for the purpose of reshaping the wireless transmission path. In addition, non-orthogonal multiple access (NOMA) protocols are considered as a new paradigm to address spectrum shortage and enhance connection quality. Considering the UAV energy consumption, the satellite transmission beamforming matrix and RIS phase shift configuration, a multi-objective optimization problem is proposed to maximize the system achievable rate and minimize the UAV energy consumption during a specific mission. On this foundation, to facilitate the online decision problem, the deep reinforcement learning (DRL) algorithm is utilized to achieve real-time interaction with the communication environment. A multi-objective deep deterministic policy gradient (MO-DDPG) algorithm is proposed to search for sub-optimal solutions about the learning problem of multi-objective control policies in IS-UAV-TNs. Experimental results show that the method can simultaneously consider three optimization objectives and effectively adjust the optimal update policy according to the settings of different weight parameters.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Deep Reinforcement Learning and NOMA-Based Multi-Objective RIS-Assisted IS-UAV-TNs: Trajectory Optimization and Beamforming Design


    Beteiligte:
    Guo, Kefeng (Autor:in) / Wu, Min (Autor:in) / Li, Xingwang (Autor:in) / Song, Houbing (Autor:in) / Kumar, Neeraj (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2023-09-01


    Format / Umfang :

    7287919 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-Objective Deep Reinforcement Learning for Crowd Route Guidance Optimization

    Nishida, Ryo / Tanigaki, Yuki / Onishi, Masaki et al. | Transportation Research Record | 2023


    Multichannel Relay assisted NOMA-ALOHA with Reinforcement Learning based Random Access

    Lee, Haeyoung / Lee, Sunyoung / Ko, Youngwook | IEEE | 2023



    Multi-objective Trajectory Optimization Problem

    Chai, Runqi / Savvaris, Al / Tsourdos, Antonios et al. | Springer Verlag | 2019


    Beamforming in Multi-User MISO Cellular Networks with Deep Reinforcement Learning

    Chen, Hongchao / Zheng, Zhe / Liang, Xiaohui et al. | IEEE | 2021