The invention discloses a reinforcement learning-based optimal scheduling method for an electric vehicle to participate in an energy storage market, and relates to the technical field of energy management, and the method comprises the steps: constructing a vehicle intelligent agent and an optimization target of the vehicle intelligent agent; dynamically executing the action of each vehicle agent and pre-introducing a reward function for optimizing a target weight coefficient so as to coordinate the charging sequence among the vehicle agents; constructing a schedulable amount solving model of the vehicle intelligent agents, and solving the schedulable amounts of the vehicle intelligent agents in different areas; and taking the schedulable amount of the vehicle intelligent agent as the input of the neural network model, and outputting an optimal charging planning strategy to realize the optimal scheduling of the vehicle intelligent agent cluster. By establishing private car, commercial car and taxi intelligent agents and utilizing the reinforcement learning algorithm to optimize the operation strategy of the electric vehicle, the problem that the electric vehicle is connected to the power grid in a large scale to cause impact on the power system is solved.

    本发明公开了一种基于强化学习的电动汽车参与储能市场的最优调度方法,涉及能量管理技术领域,该电动汽车参与储能市场的最优调度方法包括:构建车辆智能体及车辆智能体的优化目标;动态执行各车辆智能体动作及预先引入优化目标权重系数的奖励函数,以协调车辆智能体之间的充电顺序;构建车辆智能体的可调度量求解模型,求解不同区域的车辆智能体的可调度量;将车辆智能体的可调度量作为神经网络模型的输入,并输出最优充电规划策略,实现车辆智能体集群的最优调度。本发明通过建立私家车、商务车、出租车智能体及利用强化学习算法优化电动汽车的运行策略,解决电动汽车大规模接入电网将对电力系统造成冲击的问题。


    Access

    Download


    Export, share and cite



    Title :

    Optimal scheduling method for electric vehicles to participate in energy storage market based on reinforcement learning


    Additional title:

    一种基于强化学习的电动汽车参与储能市场的最优调度方法


    Contributors:
    WANG HAOJING (author) / CAO ZHIJIE (author) / ZHANG YU (author) / YANG XINGANG (author) / FANG CHEN (author) / SHEN BING (author) / SHI SHANSHAN (author) / WEI XINCHI (author) / LIU SHU (author) / ZHANG KAIYU (author)

    Publication date :

    2025-01-24


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    H02J CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER , Schaltungsanordnungen oder Systeme für die Abgabe oder Verteilung elektrischer Leistung / B60L PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES , Antrieb von elektrisch angetriebenen Fahrzeugen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES



    OPTIMAL ALLOCATION METHOD FOR STORED ENERGY COORDINATING ELECTRIC VEHICLES TO PARTICIPATE IN AUXILIARY SERVICE MARKET

    LIU DUNNAN / LIU MINGGUANG / PENG XIAOFENG et al. | European Patent Office | 2022

    Free access

    Optimal allocation method for stored energy coordinating electric vehicles to participate in ancillary service market

    LIU DUNNAN / LIU MINGGUANG / PENG XIAOFENG et al. | European Patent Office | 2024

    Free access

    Reinforcement Learning Based Energy Management of Hybrid Energy Storage Systems in Electric Vehicles

    Haskara, Ibrahim / Hegde, Bharatkumar / Chang, Chen-Fang | British Library Conference Proceedings | 2021


    Reinforcement Learning Based Energy Management of Hybrid Energy Storage Systems in Electric Vehicles

    Hegde, Bharatkumar / Chang, Chen-Fang / Haskara, Ibrahim | SAE Technical Papers | 2021


    Scheduling method for electric vehicle aggregation to participate in power market auxiliary peak regulation service

    WU NING / XIAO JING / CHEN WEIDONG et al. | European Patent Office | 2024

    Free access