Vehicle-to-vehicle (V2V) communications have distinct challenges that need to be taken into account when scheduling the radio resources. Although centralized schedulers (e.g., located on base stations) could be utilized to deliver high scheduling performance, they cannot be employed in case of coverage gaps. To address the issue of reliable scheduling of V2V transmissions out of coverage, we propose Vehicular Reinforcement Learning Scheduler (VRLS), a centralized scheduler that predictively assigns the resources for V2V communication while the vehicle is still in cellular network coverage. VRLS is a unified reinforcement learning (RL) solution, wherein the learning agent, the state representation, and the reward provided to the agent are applicable to different vehicular environments of interest (in terms of vehicular density, resource configuration, and wireless channel conditions). Such a unified solution eliminates the necessity of redesigning the RL components for a different environment, and facilitates transfer learning from one to another similar environment. We evaluate the performance of VRLS and show its ability to avoid collisions and half-duplex errors, and to reuse the resources better than the state of the art scheduling algorithms. We also show that pre- trained VRLS agent can adapt to different V2V environments with limited retraining, thus enabling real-world deployment in different scenarios.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    VRLS: A Unified Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications


    Contributors:
    Sahin, Taylan (author) / Khalili, Ramin (author) / Boban, Mate (author) / Wolisz, Adam (author)


    Publication date :

    2019-09-01


    Size :

    202337 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications Outside Coverage

    Sahin, Taylan / Khalili, Ramin / Boban, Mate et al. | IEEE | 2018


    VEHICLE CHARGING SCHEDULER

    PENG JAMES | European Patent Office | 2021

    Free access

    Electric vehicle charging scheduler

    ROSENE LEO JOSEPH / AL-KHAFAJI AMEEN / L'ARRIVÉE COURTNEY et al. | European Patent Office | 2021

    Free access

    ELECTRIC VEHICLE CHARGING SCHEDULER

    ROSENE LEO JOSEPH / AL-KHAFAJI AMEEN / L'ARRIVÉE COURTNEY et al. | European Patent Office | 2020

    Free access

    ELECTRIC VEHICLE CHARGING SCHEDULER

    ROSENE LEO JOSEPH / AL-KHAFAJI AMEEN / L'ARRIVEE COURTNEY et al. | European Patent Office | 2020

    Free access