The real-time control optimization of electrified vehicles is one of the most demanding tasks to be faced in the innovation progress of low-emissions mobility. Intelligent energy management systems represent interesting solutions to solve complex control problems, such as the maximization of the fuel economy of hybrid electric vehicles. In the recent years, reinforcement-learning-based controllers have been shown to outperform well-established real-time strategies for specific applications. Nevertheless, the effects produced by variation in the reward function have not been thoroughly analyzed and the potential of the adoption of a given RL agent under different testing conditions is still to be assessed. In the present paper, the performance of different agents, i.e., Q-learning, deep Q-Network and double deep Q-Network, are investigated considering a full hybrid electric vehicle throughout multiple driving missions and introducing two distinct reward functions. The first function aims at guaranteeing a charge-sustaining policy whilst reducing the fuel consumption (FC) as much as possible; the second function in turn aims at minimizing the fuel consumption whilst ensuring an acceptable battery state of charge (SOC) by the end of the mission. The novelty brought by the results of this paper lies in the demonstration of a non-trivial incapability of DQN and DDQN to outperform traditional Q-learning when a SOC-oriented reward is considered. On the contrary, optimal fuel consumption reductions are attained by DQN and DDQN when more complex FC-oriented minimization is deployed. Such an important outcome is particularly evident when the RL agents are trained on regulatory driving cycles and tested on unknown real-world driving missions.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Influence of the Reward Function on the Selection of Reinforcement Learning Agents for Hybrid Electric Vehicles Real-Time Control



    Erscheinungsdatum :

    2023-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Reward function for vehicles

    RESHEF ROI | Europäisches Patentamt | 2023

    Freier Zugriff

    REWARD FUNCTION FOR VEHICLES

    RESHEF ROI | Europäisches Patentamt | 2023

    Freier Zugriff

    Data-Driven Reinforcement Learning–Based Real-Time Energy Management System for Plug-In Hybrid Electric Vehicles

    Qi, Xuewei / Wu, Guoyuan / Boriboonsomsin, Kanok et al. | Transportation Research Record | 2016


    Reward Function Design in Multi-Agent Reinforcement Learning for Traffic Signal Control

    Koohy, Behrad / Stein, Sebastian / Gerding, Enrico et al. | TIBKAT | 2022

    Freier Zugriff

    Reward Function Design for Stand-Off Tracking of Reinforcement Learning

    Jung, Yeontaek / Kim, Jinrae / Kim, Seong-Hun et al. | TIBKAT | 2023