The invention provides an electric vehicle charging and discharging decision-making method based on a hybrid action space, and relates to the technical field of electric vehicles. The method specifically comprises the following steps: constructing a multi-agent charging system comprising a plurality of electric vehicle charging models; respectively constructing a state space, a mixed action space and a reward function; a mixed action space multi-agent soft action-comment algorithm is adopted to construct a multi-agent reinforcement learning framework for the multi-agent charging system, and initialization is carried out; the state of the electric vehicle at the moment t is obtained, and then the initialized multi-agent reinforcement learning framework is used for obtaining the continuous action selected by the electric vehicle at the moment t, the instantaneous reward of the electric vehicle at the moment t and the state of the electric vehicle at the moment t + 1, and the continuous action, the instantaneous reward and the state are put into an experience pool; and randomly extracting a data sample from the experience pool and inputting the data sample into the multi-agent reinforcement learning framework to train network parameters to obtain a trained multi-agent reinforcement learning framework for solving the charging and discharging decision problem of the electric vehicle.

    本发明提供基于混合动作空间的电动汽车充放电决策方法,涉及电动汽车技术领域。该方法具体包括:构建包括若干个电动汽车充电模型的多智能体充电系统;分别构建状态空间、混合动作空间和奖赏函数;采用混合动作空间多智能体软动作‑评论算法为多智能体充电系统构建多智能体强化学习框架并进行初始化;获取t时刻电动汽车的状态,再利用初始化后的多智能体强化学习框架得到t时刻电动汽车选择的连续动作、t时刻电动汽车的瞬时奖励和t+1时刻电动汽车的状态,并放入经验池;从经验池从随机抽取数据样本并输入到多智能体强化学习框架中训练网络参数,得到训练好的多智能体强化学习框架,用于解决电动汽车的充放电决策问题。


    Access

    Download


    Export, share and cite



    Title :

    Electric vehicle charging and discharging decision-making method based on mixed action space


    Additional title:

    基于混合动作空间的电动汽车充放电决策方法


    Contributors:
    ZHAO QIANG (author) / LIU HUI (author) / HAN YINGHUA (author)

    Publication date :

    2024-12-20


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    B60L PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES , Antrieb von elektrisch angetriebenen Fahrzeugen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES



    Electric vehicle charging and discharging decision-making method

    XIE TUO / LIU HONG / ZHANG GANG et al. | European Patent Office | 2023

    Free access


    Electric vehicle, charging/discharging device, and charging/discharging management system

    SAKATA HIDEKI / ASAKURA JUN / YAMAUCHI YUTAKA et al. | European Patent Office | 2023

    Free access

    Charging/discharging device and charging/discharging system for electric vehicle

    JIA MINLI / SUN HAO / ZHANG JINFA | European Patent Office | 2021

    Free access

    ELECTRIC VEHICLE CHARGING/DISCHARGING DEVICE

    TOYODA KAZUHO / HOSOMI TAKAYA / TAKAGUCHI RYOSUKE | European Patent Office | 2025

    Free access