Energy management strategy (EMS) is a crucial technology for ensuring the fuel efficiency of hybrid electric vehicles (HEVs). However, complex discrete–continuous hybrid action space and physical constraints in the powertrain of HEVs present a challenge for developing high-performance EMSs based on deep reinforcement learning (DRL). This article proposes a constrained hierarchical hybrid $Q$ -network (CHHQN) algorithm, based on which a two-level EMS framework is built for direct learning within the hybrid action space, encompassing both torque distribution and gear-shifting strategies. To ensure that critical metrics such as battery’s state of charge are not violated, the designed EMS introduces an additional safety layer to correct the agent’s actions. The CHHQN-based EMS exhibits only a 3.73% difference to dynamic programming (DP) in fuel consumption. Comprehensive comparisons with other typical DRL-based methods, e.g., deep deterministic policy gradients (DDPGs) and deep $Q$ -network, demonstrate a considerable fuel economy improvement. The effectiveness of the proposed method is validated through a hardware-in-loop (HIL) test.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Constrained Hierarchical Hybrid Q-Network for Energy Management of HEVs


    Contributors:
    Fan, Xiaoyu (author) / Guo, Lulu (author) / Hong, Jinlong (author) / Wang, Zhenhao (author) / Chen, Hong (author)


    Publication date :

    2024-12-01


    Size :

    12005294 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Online energy management for HEVs

    Dextreit,C. / Changan UK Res.a.Dev.,GB | Automotive engineering | 2015


    Optimal energy management of HEVs with hybrid storage system

    Vinot, E. / Trigui, R. | Tema Archive | 2013


    Holistic Thermal Energy Modelling for Full Hybrid Electric Vehicles (HEVs)

    Fletcher, Tom / Kalantzis, Nikolaos / Ahmedov, Ahmed et al. | British Library Conference Proceedings | 2020



    Distance-oriented hierarchical control and ecological driving strategy for HEVs

    Zhang, Bowen / Lim, Hansang / Xu, Shengyao et al. | IET | 2019

    Free access