The single train trajectory optimization, also known as speed profile optimization (SPO), is a traditional problem to minimize the traction energy consumption of trains. As a kind of optimal method, reinforcement learning (RL) has been used to solve the SPO problem. In the learning process of a common RL algorithm, a soft constraint (punishment) is always used to keep the agent away from unsafe states. However, a soft constraint can not guarantee and explain the safety of the result. For the SPO problem, it means that the optimized speed profile obtained by a simple RL may break the speed limit which is unacceptable in reality. This paper proposes a protection mechanism called Shield and constructs a Shield SARSA ( ${S}$ -SARSA) algorithm to protect the learning process of the high-speed train. Four different reward functions are used to compare the protective efficacy between the proposed algorithm and the soft constraint. The numerical experiments based on the line data from Wuxi East to Suzhou North verify the protective efficacy and effectiveness.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Safe Reinforcement Learning for Single Train Trajectory Optimization via Shield SARSA


    Contributors:
    Zhao, Zicong (author) / Xun, Jing (author) / Wen, Xuguang (author) / Chen, Jianqiu (author)


    Publication date :

    2023-01-01


    Size :

    5384452 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Single-Train Trajectory Optimization

    Lu, S | Online Contents | 2013


    Single-Train Trajectory Optimization

    Lu, Shaofeng / Hillmansen, Stuart / Ho, Tin Kin et al. | IEEE | 2013



    Hierarchical Sarsa Learning Based Route Guidance Algorithm

    Feng Wen / Xingqiao Wang / Xiaowei Xu | DOAJ | 2019

    Free access

    Intelligent Control Strategy of Urban Rail Train Based on Sarsa(λ) Algorithm

    Jiang, Xiaoyi / Shi, Kun / Liu, Yatong et al. | IEEE | 2024