The single train trajectory optimization, also known as speed profile optimization (SPO), is a traditional problem to minimize the traction energy consumption of trains. As a kind of optimal method, reinforcement learning (RL) has been used to solve the SPO problem. In the learning process of a common RL algorithm, a soft constraint (punishment) is always used to keep the agent away from unsafe states. However, a soft constraint can not guarantee and explain the safety of the result. For the SPO problem, it means that the optimized speed profile obtained by a simple RL may break the speed limit which is unacceptable in reality. This paper proposes a protection mechanism called Shield and constructs a Shield SARSA ( ${S}$ -SARSA) algorithm to protect the learning process of the high-speed train. Four different reward functions are used to compare the protective efficacy between the proposed algorithm and the soft constraint. The numerical experiments based on the line data from Wuxi East to Suzhou North verify the protective efficacy and effectiveness.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Safe Reinforcement Learning for Single Train Trajectory Optimization via Shield SARSA


    Beteiligte:
    Zhao, Zicong (Autor:in) / Xun, Jing (Autor:in) / Wen, Xuguang (Autor:in) / Chen, Jianqiu (Autor:in)


    Erscheinungsdatum :

    2023-01-01


    Format / Umfang :

    5384452 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Hierarchical Sarsa Learning Based Route Guidance Algorithm

    Feng Wen / Xingqiao Wang / Xiaowei Xu | DOAJ | 2019

    Freier Zugriff

    Single-Train Trajectory Optimization

    Lu, S | Online Contents | 2013


    Single-Train Trajectory Optimization

    Lu, Shaofeng / Hillmansen, Stuart / Ho, Tin Kin et al. | IEEE | 2013


    SARSA-based trunk line traffic control optimization method

    LIN JING / WEI PING / CHAI ZIHUI et al. | Europäisches Patentamt | 2021

    Freier Zugriff

    Safe Trajectory Sampling in Model-Based Reinforcement Learning

    Zwane, S / Hadjivelichkov, D / Luo, Y et al. | BASE | 2023

    Freier Zugriff