In vehicular edge computing, efficient strategies for model deployment and task offloading offer tremendous potential to reduce response time for machine learning inference. However, existing works do not pay much attention to that there are shared structures among different types of inference tasks. This limits the improvement in response time. This paper aims to fill this gap by investigating a share-aware joint model deployment and task offloading problem for multi-task inference in vehicular edge computing. We formulate the problem with an objective to minimize the total response time of all inference requests, under constraints of per task response time, per roadside unit storage capacity, etc. We prove that the formulated problem is NP-hard. To solve the problem, a time period aware algorithm, called TPA, is proposed with guaranteed approximation ratio. In TPA, an iterative approach is designed to solve the problem of maximizing system throughput during a certain time period. Then, the certain time period approximates to the minimum time period of completing all requests. The algorithms are evaluated in the environment comprising two CPUs, two GPUs, state-of-the-art multi-task learning models and the dataset of Google cluster-usage trace. Simulation results derived from this environment show that, the proposed TPA outperforms the state-of-the-art methods for all cases, in terms of the total response time of all requests. For example, TPA can significantly reduce the total response time by at least 73.72% for different numbers of RSUs considered, compared with state-of-the-art methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Share-Aware Joint Model Deployment and Task Offloading for Multi-Task Inference


    Contributors:
    Wu, Yalan (author) / Wu, Jigang (author) / Chen, Long (author) / Liu, Bosheng (author) / Yao, Mianyang (author) / Lam, Siew Kei (author)


    Publication date :

    2024-06-01


    Size :

    9418878 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Joint UAV Deployment and Task Offloading Scheme for Multi-UAV-Assisted Edge Computing

    Fan Li / Juan Luo / Ying Qiao et al. | DOAJ | 2023

    Free access

    INTELLIGENT TASK OFFLOADING

    INAM RAFIA / HATA ALBERTO / RUGGERI FRANCO et al. | European Patent Office | 2022

    Free access

    INTELLIGENT TASK OFFLOADING

    INAM RAFIA / HATA ALBERTO / RUGGERI FRANCO et al. | European Patent Office | 2024

    Free access


    Privacy-Aware Multiagent Deep Reinforcement Learning for Task Offloading in VANET

    Wei, Dawei / Zhang, Junying / Shojafar, Mohammad et al. | IEEE | 2023