Content caching offers an effective solution to reduce the traffic load and alleviate the burden on backhaul links in future wireless networks. In this paper, we study the converged networks to push and cache the popular services. The popular services are delivered by the broadcasting networks, and cached in the router nodes in a distributed cache network. Due to the limited storage capacity of the router node, we formulate the service scheduling problem as a Markov Decision Process (MDP), aiming to maximize the equivalent throughput. Considering the large state space involved in the distributed cache network, it is great challenge to obtain a tractable solution by the classical optimization algorithm. To tackle this problem, we propose a service scheduling strategy based on deep Q-learning. Simulation results demonstrate that the proposed scheme can significantly improve the equivalent throughput of the converged networks.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Distributed Caching Popular Services by Using Deep Q-Learning in Converged Networks


    Contributors:
    Fang, Yuzhe (author) / Xiong, Jian (author) / Cheng, Peng (author) / Zhang, Wei (author)


    Publication date :

    2019-09-01


    Size :

    835533 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Intelligent Caching Based on Popular Content in Vehicular Networks: A Deep Transfer Learning Approach

    Wasim Abbas Ashraf, M. / Raza, Arif / Singh, Arvind R. et al. | IEEE | 2024


    Distributed Edge Caching via Reinforcement Learning in Fog Radio Access Networks

    Lu, Liuyang / Jiang, Yanxiang / Bennis, Mehdi et al. | IEEE | 2019


    VeSoNet: Traffic-Aware Content Caching for Vehicular Social Networks Using Deep Reinforcement Learning

    Aung, Nyothiri / Dhelim, Sahraoui / Chen, Liming et al. | IEEE | 2023

    Free access

    Get safeguards ready for converged networks

    British Library Online Contents | 2005


    Flexible TWDM PON with WDM overlay for converged services

    Cheng, Ning | British Library Online Contents | 2015