This paper proposes a dynamic resource trading scheme in unmanned aerial vehicle (UAV)-assisted mobile edge computing (MEC) network. A UAV-assisted MEC server adaptively adjusts its trajectory to sell the computation offloading services to the mobile users (MUs), where the MUs have stochastic task arrivals. In this context, we formulate the sequential resource trading problem as a stochastic Stackelberg game, which is composed of two stages for each trading round. In the first stage, the self-interested UAV jointly optimizes its trajectory and service price to maximize its long-term profits. In the second stage, the non-cooperative MUs optimize their binary offloading decisions to minimize the average task processing delay and service payment. However, it is challenging to obtain the equilibrium across the fully decentralized agents with constantly evolving and tightly coupled policies, where each agent is confronted with a non-stationary environment. To solve this problem, we propose an opponent modeling based double deep Q learning (OM-DDQN) algorithm, where each agent adopts opponent modeling to effectively predict the trading strategies of other agents in the network. Simulation results demonstrate that, compared with the baseline algorithms, the proposed algorithm can achieve a win-win resource trading outcome that not only enhances the UAV's profit but also reduces the MUs' costs.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Opponent Modeling Based Dynamic Resource Trading for UAV-Assisted Edge Computing


    Contributors:
    Bai, Jinxiang (author) / Wang, Zhe (author) / Li, Jun (author) / Shi, Long (author) / Zhang, Jie (author) / Wei, Kang (author) / He, Hengtao (author)


    Publication date :

    2023-10-10


    Size :

    5787079 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Interactive computerized air combat opponent

    Hankins, W. W., III | NTRS | 1976


    DYNAMIC EDGE COMPUTING WITH RESOURCE ALLOCATION TARGETING AUTONOMOUS VEHICLES

    RAKSHIT SARBAJIT K / KARRI VENKATA VARA PRASAD / MOYAL SHAILENDRA et al. | European Patent Office | 2023

    Free access

    UAV-Assisted Edge computing with 3D Trajectory Design and Resource Allocation

    Wen, Pengle / Hu, Xiaoyan / Wong, Kai-Kit | IEEE | 2023


    Resource Awareness In Unmanned Aerial Vehicle-Assisted Mobile-Edge Computing Systems

    Chen, Xianfu / Chen, Tao / Zhao, Zhifeng et al. | IEEE | 2020


    Resource awareness in unmanned aerial vehicle-assisted mobile-edge computing systems

    Chen, X. (Xianfu) / Chen, T. (Tao) / Zhao, Z. (Zhifeng) et al. | BASE | 2020

    Free access