Energy management strategy (EMS) is a crucial technology for ensuring the fuel efficiency of hybrid electric vehicles (HEVs). However, complex discrete–continuous hybrid action space and physical constraints in the powertrain of HEVs present a challenge for developing high-performance EMSs based on deep reinforcement learning (DRL). This article proposes a constrained hierarchical hybrid $Q$ -network (CHHQN) algorithm, based on which a two-level EMS framework is built for direct learning within the hybrid action space, encompassing both torque distribution and gear-shifting strategies. To ensure that critical metrics such as battery’s state of charge are not violated, the designed EMS introduces an additional safety layer to correct the agent’s actions. The CHHQN-based EMS exhibits only a 3.73% difference to dynamic programming (DP) in fuel consumption. Comprehensive comparisons with other typical DRL-based methods, e.g., deep deterministic policy gradients (DDPGs) and deep $Q$ -network, demonstrate a considerable fuel economy improvement. The effectiveness of the proposed method is validated through a hardware-in-loop (HIL) test.
Constrained Hierarchical Hybrid Q-Network for Energy Management of HEVs
IEEE Transactions on Transportation Electrification ; 10 , 4 ; 9579-9590
2024-12-01
12005294 byte
Article (Journal)
Electronic Resource
English
Online energy management for HEVs
Automotive engineering | 2015
|Optimal energy management of HEVs with hybrid storage system
Tema Archive | 2013
|Holistic Thermal Energy Modelling for Full Hybrid Electric Vehicles (HEVs)
British Library Conference Proceedings | 2020
|Distance-oriented hierarchical control and ecological driving strategy for HEVs
IET | 2019
|