Radio resources in vehicle-to-vehicle (V2V) communication can be scheduled either by a centralized scheduler residing in the network (e.g., a base station in case of cellular systems) or a distributed scheduler, where the resources are autonomously selected by the vehicles. The former approach yields a considerably higher resource utilization in case the network coverage is uninterrupted. However, in case of intermittent or-of-coverage, due to not having input from centralized scheduler, vehicles need to revert to distributed scheduling.Motivated by recent advances in reinforcement learning (RL), we investigate whether a centralized learning scheduler can be taught to efficiently pre-assign the resources to vehicles for-of-coverage V2V communication. Specifically, we use the actor-critic RL algorithm to train the centralized scheduler to provide non-interfering resources to vehicles before they enter the-of-coverage area.Our initial results show that a RL-based scheduler can achieve performance as good as or better than the state-of-art distributed scheduler, often outperforming it. Furthermore, the learning process completes within a reasonable time (ranging from a few hundred to a few thousand epochs), thus making the RL-based scheduler a promising solution for V2V communications with intermittent network coverage.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications Outside Coverage


    Contributors:
    Sahin, Taylan (author) / Khalili, Ramin (author) / Boban, Mate (author) / Wolisz, Adam (author)


    Publication date :

    2018-12-01


    Size :

    695596 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    VRLS: A Unified Reinforcement Learning Scheduler for Vehicle-to-Vehicle Communications

    Sahin, Taylan / Khalili, Ramin / Boban, Mate et al. | IEEE | 2019


    iVRLS: In-coverage Vehicular Reinforcement Learning Scheduler

    Sahin, Taylan / Boban, Mate / Khalili, Ramin et al. | IEEE | 2021


    VEHICLE CHARGING SCHEDULER

    PENG JAMES | European Patent Office | 2021

    Free access

    Electric vehicle charging scheduler

    ROSENE LEO JOSEPH / AL-KHAFAJI AMEEN / L'ARRIVÉE COURTNEY et al. | European Patent Office | 2021

    Free access

    ELECTRIC VEHICLE CHARGING SCHEDULER

    ROSENE LEO JOSEPH / AL-KHAFAJI AMEEN / L'ARRIVÉE COURTNEY et al. | European Patent Office | 2020

    Free access