In this article, we investigate the problem of optimizing the joint offloading policy in a distributed manner for multiple intelligent vehicles (IVs). During the journey in vehicular edge computing (VEC) networks, IVs continually optimize their joint offloading policy to minimize the long-term accumulated costs generated by executing computational tasks. The stochastic and repetitive interactions among IVs is modeled as a Markov game process. In this way, the optimization of the joint offloading policy is transformed to approximate a Markov perfect equilibrium in a general-sum Markov game. Moreover, we argue that training in the practical VEC networks using the classical centralized training and decentralized executing (CTDE) framework involves challenges of privacy and computational complexity. Motivated by these, we propose a reward-shared distributed policy optimization (RSDPO) method for the considered VEC networks to optimize the joint offloading policy. The experimental results demonstrate that the set of joint offloading policies using RSDPO approximates a Markov perfect equilibrium, and our RSDPO presents significant advantages in terms of converged latency and energy consumption compared with other methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Approximate Markov Perfect Equilibrium of Joint Offloading Policy for Multi-IV Using Reward-Shared Distributed Method


    Contributors:
    Li, Chao (author) / Liu, Fagui (author) / Wang, Bin (author) / Tang, Xuhao (author) / Liu, Jie (author) / Chen, C. L. Philip (author)

    Published in:

    Publication date :

    2024-02-01


    Size :

    1957810 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Air-ground joint trajectory planning and offloading scheduling method and system for distributed multiple objectives

    HUANG YANG / DONG MIAOMIAO / ZHU XINYU et al. | European Patent Office | 2024

    Free access

    Share-Aware Joint Model Deployment and Task Offloading for Multi-Task Inference

    Wu, Yalan / Wu, Jigang / Chen, Long et al. | IEEE | 2024



    Distributed Computation Offloading in Resource Limited Fog Computing

    Zhu, Hongbin / Zhu, Zhenghang / Luo, Xiliang et al. | IEEE | 2019