As a novel paradigm, Vehicular Edge Computing (VEC) can effectively support computation-intensive or delay-sensitive applications in the Internet of Vehicles era. Computation offloading and resource management strategies are key technologies that directly determine the system cost in VEC networks. However, due to vehicle mobility and stochastic arrival computation tasks, designing an optimal offloading and resource allocation policy is extremely challenging. To solve this issue, a deep reinforcement learning-based intelligent offloading and power allocation scheme is proposed for minimizing the total delay cost and energy consumption in dynamic heterogeneous VEC networks. Specifically, we first construct an end-edge-cloud offloading model in a bidirectional road scenario, taking into account stochastic task arrival, time-varying channel conditions, and vehicle mobility. With the objective of minimizing the long-term total cost composed of the energy consumption and task delay, the Markov Decision Process (MDP) can be employed to solve such optimization problems. Moreover, considering the high-dimensional continuity of the action space and the dynamics of task generation, we propose a deep deterministic policy gradient-based adaptive computation offloading and power allocation (DDPG-ACOPA) algorithm to solve the formulated MDP problem. Extensive simulation results demonstrate that the proposed DDPG-ACOPA algorithm performs better in the dynamic heterogeneous VEC environment, significantly outperforming the other four baseline schemes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Reinforcement Learning-Based Adaptive Computation Offloading and Power Allocation in Vehicular Edge Computing Networks


    Contributors:
    Qiu, Bin (author) / Wang, Yunxiao (author) / Xiao, Hailin (author) / Zhang, Zhongshan (author)

    Published in:

    Publication date :

    2024-10-01


    Size :

    6149170 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Prioritized Task Offloading in Vehicular Edge Computing Using Deep Reinforcement Learning

    Uddin, Ashab / Sakr, Ahmed Hamdi / Zhang, Ning | IEEE | 2024


    Deep Reinforcement Learning Based Computation Offloading in UAV-Assisted Edge Computing

    Peiying Zhang / Yu Su / Boxiao Li et al. | DOAJ | 2023

    Free access

    Cooperative Computation Offloading in Blockchain-Based Vehicular Edge Computing Networks

    Lang, Ping / Tian, Daxin / Duan, Xuting et al. | IEEE | 2022



    A Reinforcement Learning Based Task Offloading Scheme for Vehicular Edge Computing Network

    Zhang, Jie / Guo, Hongzhi / Liu, Jiajia | Springer Verlag | 2019