The invention relates to a vehicle-station-network interactive decision-making method based on multi-agent deep reinforcement learning. The method comprises the following steps: collecting data of a charging station and data of a user new energy vehicle; constructing a distributed partially observable Markov decision model, and setting the sum of penalty caused by user energy consumption cost and charging station peak-valley difference and penalty caused by unsatisfied constraint conditions in the distributed partially observable Markov decision model as a target function; and performing centralized training and distributed execution by using a distributed partially observable Markov decision model constructed by a multi-agent reinforcement learning BiCNet algorithm to obtain an actual decision method. According to the invention, the matching of electric vehicle charging and renewable energy sources can be effectively realized, the load power consumption peak is reduced to the maximum extent, and the load peak-valley difference of the charging station is reduced.
本发明涉及基于多智能体深度强化学习的车‑站‑网互动决策方法,通过采集充电站数据以及用户新能源汽车的数据;构建分布式部分可观测马尔科夫决策模型,并在分布式部分可观测马尔科夫决策模型中设置以用户用能成本、充电站峰谷差造成的惩罚和约束条件不满足造成的惩罚之和作为目标函数;使用多智能体强化学习BiCNet算法构建的分布式部分可观测马尔科夫决策模型进行集中训练和分布式执行,得到实际决策方法。本发明能够有效地使实现电动汽车充电与可再生能源的匹配,最大化的减少了负荷用电高峰,降低了充电站负荷峰谷差。
Vehicle-station-network interaction decision-making method based on multi-agent deep reinforcement learning
基于多智能体深度强化学习的车-站-网互动决策方法
2023-03-31
Patent
Elektronische Ressource
Chinesisch
IPC: | G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES / B60L PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES , Antrieb von elektrisch angetriebenen Fahrzeugen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / H02J CIRCUIT ARRANGEMENTS OR SYSTEMS FOR SUPPLYING OR DISTRIBUTING ELECTRIC POWER , Schaltungsanordnungen oder Systeme für die Abgabe oder Verteilung elektrischer Leistung |
Intersection decision-making method based on multi-agent deep reinforcement learning
Europäisches Patentamt | 2024
|Deep reinforcement learning-based ethical-driven multi-modal decision-making method
Europäisches Patentamt | 2023
|Automatic driving vehicle overtaking decision-making method based on deep reinforcement learning
Europäisches Patentamt | 2022
|Automatic driving decision-making method based on deep reinforcement learning
Europäisches Patentamt | 2024
|