Abstract Vehicle-to-everything (V2X) communication is a growing area of communication with a variety of use cases. This paper investigates the problem of vehicle-cell association in millimeter wave (mmWave) communication networks. The aim is to maximize the time average rate per vehicular user (VUE) while ensuring a target minimum rate for all VUEs with low signaling overhead. We first formulate the user (vehicle) association problem as a discrete non-convex optimization problem. Then, by leveraging tools from machine learning, specifically distributed deep reinforcement learning (DDRL) and the asynchronous actor critic algorithm (A3C), we propose a low complexity algorithm that approximates the solution of the proposed optimization problem. The proposed DDRL-based algorithm endows every road side unit (RSU) with a local RL agent that selects a local action based on the observed input state. Actions of different RSUs are forwarded to a central entity, that computes a global reward which is then fed back to RSUs. It is shown that each independently trained RL performs the vehicle-RSU association action with low control overhead and less computational complexity compared to running an online complex algorithm to solve the non-convex optimization problem. Finally, simulation results show that the proposed solution achieves up to 15% gains in terms of sum rate and 20% reduction in VUE outages compared to several baseline designs.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement learning based vehicle-cell association algorithm for highly mobile millimeter wave communication



    Erscheinungsdatum :

    2019-01-01


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    ON-VEHICLE MILLIMETER WAVE COMMUNICATION DEVICE AND COMMUNICATION METHOD

    CAI SHENG WEI | Europäisches Patentamt | 2018

    Freier Zugriff

    Vehicle-mounted millimeter-wave communication device and communication method

    SAI SEII | Europäisches Patentamt | 2019

    Freier Zugriff

    MILLIMETER WAVE COMMUNICATION SYSTEM

    SHIMIZU TAKAYUKI / GAURAV BANSAL | Europäisches Patentamt | 2017

    Freier Zugriff

    Deep reinforcement learning for hybrid beamforming in multi-user millimeter wave wireless systems

    Lizarraga, Enrique M. / Maggio, Gabriel N. / Dowhuszko, Alexis A. | IEEE | 2021


    Effective Beam Alignment Algorithm for Low Cost Millimeter Wave Communication

    Kadur, Tobias / Chiang, Hsiao-Lan / Fettweis, Gerhard | IEEE | 2016