Railway is stepping into the field of smart railway. Unfortunately, the challenge of obtaining accurate instantaneous channel state information in high-speed railway (HSR) scenario makes it difficult to apply conventional power allocation schemes. In this paper, to respond to the challenge, we propose an innovative experience-driven power allocation algorithm in the millimeter-wave (mmWave) HSR systems with hybrid beamforming, which is capable of learning power decisions from the past experience instead of the accurate mathematical model, just like one person learns one new skill, such as driving. To be specific, with the purpose of maximizing the achievable sum rate, we first characterize the power allocation problem of the mmWave HSR systems as a multi-agent deep reinforcement learning problem and then solve it by using emerging multi-agent deep deterministic policy gradient (MADDPG) approach, which enables the agent, i.e., the mobile relay onboard the train to learn the power decisions from the past experience in a distributed manner. The simulation results indicate that the spectral efficiency of proposed MADDPG algorithm significantly outperforms existing state-of-the-art schemes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Experience-Driven Power Allocation Using Multi-Agent Deep Reinforcement Learning for Millimeter-Wave High-Speed Railway Systems


    Contributors:
    Xu, Jianpeng (author) / Ai, Bo (author)


    Publication date :

    2022-06-01


    Size :

    1819247 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Deep reinforcement learning for hybrid beamforming in multi-user millimeter wave wireless systems

    Lizarraga, Enrique M. / Maggio, Gabriel N. / Dowhuszko, Alexis A. | IEEE | 2021


    Dynamic Variable Speed Limit Zones Allocation Using Distributed Multi-Agent Reinforcement Learning

    Kusic, Kresimir / Ivanjko, Edouard / Vrbanic, Filip et al. | IEEE | 2021


    Power Allocation in Multi-Cell Networks Using Deep Reinforcement Learning

    Zhang, Yong / Kang, Canping / Ma, Tengteng et al. | IEEE | 2018


    Deep Reinforcement Learning for Event-Driven Multi-Agent Decision Processes

    Menda, Kunal / Chen, Yi-Chun / Grana, Justin et al. | IEEE | 2019