In this article, we investigate the problem of optimizing the joint offloading policy in a distributed manner for multiple intelligent vehicles (IVs). During the journey in vehicular edge computing (VEC) networks, IVs continually optimize their joint offloading policy to minimize the long-term accumulated costs generated by executing computational tasks. The stochastic and repetitive interactions among IVs is modeled as a Markov game process. In this way, the optimization of the joint offloading policy is transformed to approximate a Markov perfect equilibrium in a general-sum Markov game. Moreover, we argue that training in the practical VEC networks using the classical centralized training and decentralized executing (CTDE) framework involves challenges of privacy and computational complexity. Motivated by these, we propose a reward-shared distributed policy optimization (RSDPO) method for the considered VEC networks to optimize the joint offloading policy. The experimental results demonstrate that the set of joint offloading policies using RSDPO approximates a Markov perfect equilibrium, and our RSDPO presents significant advantages in terms of converged latency and energy consumption compared with other methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Approximate Markov Perfect Equilibrium of Joint Offloading Policy for Multi-IV Using Reward-Shared Distributed Method


    Beteiligte:
    Li, Chao (Autor:in) / Liu, Fagui (Autor:in) / Wang, Bin (Autor:in) / Tang, Xuhao (Autor:in) / Liu, Jie (Autor:in) / Chen, C. L. Philip (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2024-02-01


    Format / Umfang :

    1957810 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Air-ground joint trajectory planning and offloading scheduling method and system for distributed multiple objectives

    HUANG YANG / DONG MIAOMIAO / ZHU XINYU et al. | Europäisches Patentamt | 2024

    Freier Zugriff


    Share-Aware Joint Model Deployment and Task Offloading for Multi-Task Inference

    Wu, Yalan / Wu, Jigang / Chen, Long et al. | IEEE | 2024


    LIQUEFIED NATURAL GAS OFFLOADING SYSTEM AND OFFLOADING METHOD

    Europäisches Patentamt | 2015

    Freier Zugriff