The invention discloses a calculation unloading and power distribution method in a motorcade network based on deep reinforcement learning, and the method specifically comprises the steps: building a calculation model of a motorcade system by taking the minimization of the average energy consumption and task data processing delay of the motorcade system as a target; according to a multi-agent DRL-based method, a motorcade network is regarded as an environment, and each PM is regarded as an agent capable of interacting with a dynamic environment; the goal pursued by each agent is to maximize long-term discount rewards; in the learning process, decisions made by the intelligent agent based on the state are driven by rewards, and calculation unloading and power distribution joint optimization are carried out. According to the calculation unloading and power distribution optimization model in the motorcade network provided by the invention, the mobility, communication interference and vehicle cooperation of the vehicles are comprehensively considered; the method can adapt to a fast moving motorcade network environment; the time sequence characteristics of the environment state can be captured, and a more accurate power distribution action can be performed.

    本发明公开了一种基于深度强化学习的车队网络内计算卸载与功率分配方法,具体为:以最小化车队系统平均能耗和任务数据处理延迟为目标,建立车队系统的计算模型;根据基于多智能体DRL的方法,将车队网络视为一个环境,将每个PM视为可以与动态环境交互的智能体;每个智能体追求的目标是最大化长期折扣奖励;在学习过程中,智能体基于状态做出的决策是由奖励驱动的,进行计算卸载和功率分配联合优化。本发明提出的车队网络中计算卸载和功率分配优化模型综合考虑了车辆的移动性、通信干扰以及车辆协作;能够适应快速移动的车队网络环境;能够捕获环境状态的时序特征,能做出更加准确的功率分配动作。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Computing unloading and power distribution method in motorcade network based on deep reinforcement learning


    Weitere Titelangaben:

    基于深度强化学习的车队网络内计算卸载与功率分配方法


    Beteiligte:
    WANG LEI (Autor:in) / HONG XINTAO (Autor:in) / LIANG HONGBIN (Autor:in)

    Erscheinungsdatum :

    2024-03-01


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    H04W WIRELESS COMMUNICATION NETWORKS , Drahtlose Kommunikationsnetze / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Motorcade management control system and motorcade management control method

    LIN GUANLUN | Europäisches Patentamt | 2020

    Freier Zugriff

    Method for controlling bikes to enter motorcade by changing lanes based on curriculum reinforcement learning

    LIU HONGFEI / YANG XIAO / WAN JINTAO et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Motorcade control method based on automatic driving

    BI SHANSHAN / FENG SONG | Europäisches Patentamt | 2023

    Freier Zugriff

    Motorcade charging station architecture

    PARHIPATI VAMSI KRISHNA | Europäisches Patentamt | 2024

    Freier Zugriff

    Motorcade collaborative driving cruise control method

    MA YULIN / XU YANG / HUANG ZICHAO et al. | Europäisches Patentamt | 2020

    Freier Zugriff