The safety driving-related content demands of vehicle users increase rapidly, especially with the development of autonomous driving. It is significantly necessary to obtain the safety-related transportation information of an area when vehicles are drove there, whether or not they are controlled by human being. However, vehicular content caching can bring issues in distributed-fashion, such as high response delay and low content response ratio because of the poor traffic condition and the obstructions of buildings. As a consequence, we adopt UAVs (Unmanned Aerial Vehicles) to assist the driving safety-related content caching for vehicles. Besides, since the power energy and the caching storage of UAVs are limited, it is needed to design an optimal caching scheme to guarantee the driving safety-related content demands of vehicle users as well as reduce the energy consumption of UAVs. In this article, we propose a novel deep Q-learning based air-assisted vehicular caching scheme to respond to the driving safety-related content requests of vehicle users. First, a three-layered content response architecture is introduced, where an airship is leveraged to take charge of the scheduling of UAVs to improve the content response. Then, a multi-objective mathematical model is built to describe the specific problem of the proposed scheme. Finally, deep Q-learning is applied to solve the multi-objective problem by learning from the history content requests of vehicle users. Extensive experiments have been conducted which show the proposed scheme outperforms its counterparts in terms of content hit ratio, response delay, being scheduling probability and packet buffering time.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Novel Deep Q-Learning-Based Air-Assisted Vehicular Caching Scheme for Safe Autonomous Driving


    Contributors:
    Shi, Junling (author) / Zhao, Liang (author) / Wang, Xingwei (author) / Zhao, Weiliang (author) / Hawbani, Ammar (author) / Huang, Min (author)


    Publication date :

    2021-07-01


    Size :

    1806183 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    ICN Based Efficient Content Caching Scheme for Vehicular Networks

    Gupta, Divya / Rani, Shalli / Singh, Aman et al. | IEEE | 2023



    Deep Learning for Safe Autonomous Driving: Current Challenges and Future Directions

    Muhammad, Khan / Ullah, Amin / Lloret, Jaime et al. | IEEE | 2021

    Free access

    Optimal Probabilistic Collaborative Caching in UAV-Assisted Vehicular Networks

    Zhao, Shuyuan / Zhang, Yuan / Zhu, Yongdong et al. | IEEE | 2022


    Safe and Rule-Aware Deep Reinforcement Learning for Autonomous Driving at Intersections

    Zhang, Chi / Kacem, Kais / Hinz, Gereon et al. | IEEE | 2022