The invention discloses a parallel hybrid electric vehicle energy management method based on hierarchical reinforcement learning. The method is characterized in that the method comprises the steps: S1, building a simulation model of a parallel vehicle; S2, constructing an energy management control model and a reward function; S3, constructing a network structure of a hierarchical reinforcement learning algorithm; S4, training and updating the hierarchical reinforcement learning algorithm; and S5, performing energy management of the parallel hybrid electric vehicle under different working conditions based on parameters influencing energy management in actual driving of the vehicle and the trained hierarchical reinforcement learning algorithm. According to the invention, the vehicle can more effectively find the exploration mode with the lowest fuel oil, the problem that reward sparsity occurs when the reinforcement learning intelligent body faces all working conditions is solved, and meanwhile the convergence speed of the reinforcement learning algorithm is increased.

    本发明公开了一种基于分层强化学习的并联式混合动力汽车能量管理方法,其特征在于,包括:S1:建立并联式汽车的仿真模型;S2:构建能量管理控制模型以及奖励函数;S3:构建分层强化学习算法的网络结构;S4:对分层强化学习算法进行训练更新;S5:基于汽车实际行驶中影响能量管理的参数以及训练后的分层强化学习算法,进行并联式混合动力汽车不同工况下的能量管理。本发明使得车辆更有效地寻找到燃油最低的探索方式,解决了强化学习智能体面对各个工况时出现reward稀疏的问题,同时提高了强化学习算法的收敛速度。


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Parallel hybrid electric vehicle energy management method based on hierarchical reinforcement learning


    Weitere Titelangaben:

    基于分层强化学习的并联式混合动力汽车能量管理方法


    Beteiligte:
    XIAO FENG (Autor:in) / QI CHUNYANG (Autor:in)

    Erscheinungsdatum :

    2022-02-01


    Medientyp :

    Patent


    Format :

    Elektronische Ressource


    Sprache :

    Chinesisch


    Klassifikation :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion



    Hierarchical energy management method for hybrid electric vehicle based on deep reinforcement learning algorithm

    FU ZHUMU / GONG HUIXIAN / TAO FAZHAN et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Hybrid electric vehicle energy management method based on reinforcement learning

    LOU DIMING / ZHAO YINGHUA | Europäisches Patentamt | 2021

    Freier Zugriff

    Fuel cell hybrid electric vehicle energy management method based on deep reinforcement learning

    MA YAN / LUAN YU | Europäisches Patentamt | 2024

    Freier Zugriff

    Energy Management Based on D4QN Reinforcement Learning for a Series-Parallel Multi-Speed Hybrid Electric Vehicle

    Zhuang, Caihua / Lou, Diming / Fang, Liang et al. | SAE Technical Papers | 2023


    Hybrid electric vehicle adaptive energy management framework based on model reinforcement learning

    SHI CUIDUO / ZHAO KEGANG / LIANG ZHIHAO | Europäisches Patentamt | 2023

    Freier Zugriff