The traction power supply system (TPSS) is the only source of power for electric locomotives. The huge power fluctuations and complex operating conditions of the TPSS pose a challenge to the efficient operation of energy storage traction substations. The existing energy management strategies are difficult to achieve accurate charging and discharging, difficult to modify the control rules in real time, and have poor migration capability. For comparison, the reinforcement learning (RL) algorithms can address the shortcomings of rule-based energy management strategies due to their model-free feature. Therefore, this article proposes an energy management strategy based on parallel reinforcement learning (PRL) to improve the efficiency of energy utilization while speeding up the convergence of the algorithm. More specifically, a Markov decision framework is established for capturing the energy management process. The Monte Carlo sampling process is also improved to achieve offline optimization by PRL algorithms and reduce the impact of low-value power fragments on iteration speed. Meanwhile, the algorithm is modified to enable online updates. The case study shows that compared with other energy management strategies, the PRL-based energy management strategy has faster convergence speed, higher energy exchange efficiency, and better migration capability, and can adapt to various complex working conditions.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Parallel-Reinforcement-Learning-Based Online Energy Management Strategy for Energy Storage Traction Substations in Electrified Railroad


    Beteiligte:
    Luo, Jiaming (Autor:in) / Gao, Shibin (Autor:in) / Wei, Xiaoguang (Autor:in) / Tian, Zhongbei (Autor:in) / Wang, Xin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2024-03-01


    Format / Umfang :

    4215760 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Traction substations

    Warder, S.B. | Engineering Index Backfile | 1950


    Energy Management of Traction Power Substations on the DART System

    Griffiths, M. / Sanders, M. / American Society of Mechanical Engineers; Rail Transportation Division| Institute of Electrical and Electronic Engineers; Land Transportation Division; Vehicular Technology Section | British Library Conference Proceedings | 1999


    An Energy Management Strategy for Traction Substation with ESS Based on Reinforcement Learning

    Luo, Jiaming / Wei, Xiaoguang / Gao, Shibin et al. | Springer Verlag | 2024



    METHOD FOR DETERMINATION OF PROCESS LOSSES OF ELECTRIC POWER PER TRACTION AT DC RAILROAD TRACTION SUBSTATIONS

    KASHTANOV ALEKSEJ LEONIDOVICH / NEZEVAK VLADISLAV LEONIDOVICH / NIKIFOROV MIKHAIL MIKHAJLOVICH et al. | Europäisches Patentamt | 2016

    Freier Zugriff