In the daily management of high-speed railway systems, the train timetable rescheduling problem with unpredictable disturbances is a challenging task. The large number of stations and trains leads to a long-time consumption to solve the rescheduling problem, making it difficult to meet the realtime requirements in real-world railway networks. This paper proposes a policy-based reinforcement learning approach to address the high-speed railway timetable rescheduling problem, in which the agent minimizes the total delay by adjusting the departure sequence of all trains along the railway line. A two-stage Markov Decision Process model is established to model the environment where states, actions, and reward functions are designed. The proposed method contains an offline learning process and an online application process, which can give the optimal rescheduling schedule based on the current state immediately. Numerical experiments are performed over two different delay scenarios on the Beijing-Shanghai high-speed railway line. The simulation results show that our approach can find a high-quality rescheduling strategy within one second, which is superior to the First-Come-First-Served (FCFS) and First-Scheduled-First-Served (FSFS) methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Policy-Based Reinforcement Learning Approach for High-Speed Railway Timetable Rescheduling


    Beteiligte:
    Wang, Yin (Autor:in) / Lv, Yisheng (Autor:in) / Zhou, Jianying (Autor:in) / Yuan, Zhiming (Autor:in) / Zhang, Qi (Autor:in) / Zhou, Min (Autor:in)


    Erscheinungsdatum :

    2021-09-19


    Format / Umfang :

    1236139 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Reinforcement Learning in Railway Timetable Rescheduling

    Zhu, Yongqiu / Wang, Hongrui / Goverde, Rob M.P. | IEEE | 2020



    Train Timetable Rescheduling for High-Speed Railway Under Emergency Conditions

    Jia, Limin / Wang, Li / Qin, Yong | Springer Verlag | 2021


    High-Speed Railway Timetable Rescheduling Method: A Bi-level Integrated Programming Approach

    Zhang, Huiru / Jia, Limin / Wang, Li et al. | British Library Conference Proceedings | 2018


    The multi-objective railway timetable rescheduling problem

    Binder, Stefan / Maknoon, Yousef / Bierlaire, Michel | Elsevier | 2017