Great attention has been attracted to the growing energy consumption of the subway system. It is significant to investigate the energy-efficient train control methodology which is regarded as an effective way to cut down the energy cost of the subway system. In this paper, a soft actor-critic-based method is proposed to determine the optimal driving strategy. Firstly, the inverse problem of the energy-efficient train control problem, i.e., minimizing the trip time with constant traction energy, is presented, and it is converted to a finite Markov decision process which can be solved with deep reinforcement learning (DRL) algorithms. Secondly, the soft actor-critic (SAC) algorithm is proposed to determine the optimal driving strategy. Finally, the effectiveness of the proposed method is verified via the case studies. It is also illustrated that the SAC-based method has a good performance in robustness and stability. Moreover, compared with other DRL algorithms such as the deep Q network (DQN), the SAC-based method saves about 66% training steps on average to achieve the optimum, which reduces the computational resources.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Energy-efficient train control method based on soft actor-critic algorithm


    Beteiligte:
    Zhu, Q. (Autor:in) / Su, S. (Autor:in) / Tang, T. (Autor:in) / Xiao, X. (Autor:in)


    Erscheinungsdatum :

    2021-09-19


    Format / Umfang :

    826556 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Stepwise Soft Actor–Critic for UAV Autonomous Flight Control

    Ha Jun Hwang / Jaeyeon Jang / Jongkwan Choi et al. | DOAJ | 2023

    Freier Zugriff

    Multiagent Soft Actor–Critic for Traffic Light Timing

    Wu, Lan / Wu, Yuanming / Qiao, Cong et al. | ASCE | 2023


    Meta Soft Actor-Critic Based Robust Sequential Power Control in Vehicular Networks

    Liu, Zhihua / Guo, Chongtao / Guo, Cheng et al. | IEEE | 2023


    Soft Actor-Critic Deep Reinforcement Learning for Fault Tolerant Flight Control

    Dally, Killian / Kampen, Erik-Jan Van | TIBKAT | 2022