The invention relates to the technical field of electric vehicle charging and discharging, and discloses an electric vehicle charging and discharging energy management method based on deep reinforcement learning. According to the method, uncertainty caused by dynamic behaviors of the electric vehicle user is specifically described from three aspects of user psychological anxiety, charging preference and charging position, and expected electric quantity is proposed to quantitatively describe distribution of user psychological anxiety; the change characteristic of the efficiency in the actual charging and discharging process of the electric vehicle is considered, and a curve of the efficiency changing along with the power is fitted and applied to an electric vehicle battery electric quantity updating formula; providing an electric vehicle energy management method based on a double-delay depth deterministic strategy gradient algorithm, and designing a state space, an action space and a reward function of a Markov decision model; the intelligent agent obtained through training can adaptively control the charging and discharging power of the electric vehicle, the charging and discharging energy management of the electric vehicle is realized, and the purposes of responding to the time-of-use electricity price, reducing the charging cost of the user and meeting the travel requirement of the user are achieved.
本发明涉及电动汽车充放电技术领域,公开了一种基于深度强化学习的电动汽车充放电能量管理方法。该发明从用户心理焦虑、充电偏好、充电位置三个方面具体描述由电动汽车用户动态行为导致的不确定性,并提出期望电量定量描述用户心理焦虑的分布;考虑实际电动汽车充放电过程中效率的变化特性,拟合出效率随功率变化的曲线,并应用在电动汽车电池电量更新公式中;提出基于双延迟深度确定性策略梯度算法的电动汽车能量管理方法,设计马尔科夫决策模型的状态空间、动作空间和奖励函数;通过训练得到的智能体能够自适应控制电动汽车的充放电功率,实现对电动汽车充放电能量管理,达到响应分时电价,降低用户充电成本,满足用户出行需求的目的。
Electric vehicle charging and discharging energy management method based on deep reinforcement learning
一种基于深度强化学习的电动汽车充放电能量管理方法
2024-11-05
Patent
Electronic Resource
Chinese
IPC: | B60L PROPULSION OF ELECTRICALLY-PROPELLED VEHICLES , Antrieb von elektrisch angetriebenen Fahrzeugen / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES |
Electric vehicle, charging/discharging device, and charging/discharging management system
European Patent Office | 2023
|European Patent Office | 2025
|European Patent Office | 2016
|Electric vehicle and electric vehicle charging and discharging management platform
European Patent Office | 2024
|Charging/discharging device and charging/discharging system for electric vehicle
European Patent Office | 2021
|