In this paper, we investigate the resource allocation problem in a dynamic vehicular environment, where multiple vehicle-to-vehicle links attempt to reuse the spectrum of vehicle-to-infrastructure links. It is modeled as a deep reinforcement learning problem that is subject to proximal policy optimization. Training a well-performing policy usually requires a massive amount of interactions with the environment for a long time and thus is typically performed on a simulator. However, an agent well trained in a simulated environment may still fail when deployed in a live network, due to inevitable difference between the two environments, termed reality gap. We make preliminary efforts to address this issue by leveraging meta reinforcement learning that allows the learning agent to quickly adapt to a new environment with minimal interactions after being trained across a variety of similar tasks. We demonstrate that only a few episodes are required for the meta trained policy to adapt to a new environment and the proposed method is shown to achieve near-optimal performance and exhibit rapid convergence.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Fast Spectrum Sharing in Vehicular Networks: A Meta Reinforcement Learning Approach


    Contributors:
    Huang, Kai (author) / Luo, Zezhou (author) / Liang, Le (author) / Jin, Shi (author)


    Publication date :

    2022-09-01


    Size :

    737482 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Power Optimization for Spectrum Sharing in Vehicular Networks

    L. Thulasimani / A. Antinita Shilpha Daly | BASE | 2021

    Free access

    An approach to implement Reinforcement Learning for Heterogeneous Vehicular Networks

    Peshavaria, Bhavya / Kavaiya, Sagar / Patel, Dhaval K. | ArXiv | 2022

    Free access

    Distributed Cooperative Spectrum Sharing in UAV Networks Using Multi-Agent Reinforcement Learning

    Shamsoshoara, Alireza / Khaledi, Mehrdad / Afghah, Fatemeh et al. | ArXiv | 2018

    Free access


    Software-Defined Vehicular Networks With Trust Management: A Deep Reinforcement Learning Approach

    Zhang, Dajun / Yu, F. Richard / Yang, Ruizhe et al. | IEEE | 2022