In this paper, the resource allocation problem is investigated for Device-to-Device (D2D) communications underlaying cellular networks with bursty traffic arrival. We formulate an infinite horizon average reward constraint Markov decision process (CMDP) that aims at minimizing the average delay under the dropping propability constraint. Then, we present a reduced-state Bellman's equation with linear value function approximation to deal with the curse of dimensionality problem in solving the CMDP. A distributed resource allocation algorithm is derived with low computation complexity and signaling overhead, which consists of a subchannel bidding mechanism to obtain the optimal control action, and a distributed online stochastic learning algorithm to estimate the value function and the optimal Lagrangian Multipliers (LMs). Simulation results show that the performance of our proposed algorithm is very close to that achieved by the offline value iteration algorithm, and is better than various baselines algorithms.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Delay-Optimal Distributed Resource Allocation for Device-to-Device Communications


    Contributors:
    Kuang, Yiru (author) / Lei, Lei (author) / Zhong, Zhangdui (author)


    Publication date :

    2015-09-01


    Size :

    367222 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Resource Allocation for Device-to-Device Communications with Rate Guarantee

    Hsiao, Yi-Feng / Kao, Jung-Chun / Lin, Shih-Han | IEEE | 2018



    Bio-Inspired Resource Allocation for Relay-Aided Device-to-Device Communications

    Vlachos, Christoforos / Elshaer, Hisham / Chen, Jian et al. | IEEE | 2016


    A Resource Allocation Scheme Based on Maximum Tolerate Delay in Satellite Communications

    Jin, Hua Song ;Yang, Yong Feng ;Qiu, Dong Dong | Trans Tech Publications | 2013


    OFDM-based Dual-Function Radar-Communications: Optimal Resource Allocation for Fairness

    Zhu, Jia / Cui, Yuanhao / Mu, Junsheng et al. | IEEE | 2022