The present disclosure provides a method and system for controlling a heavy-haul train based on reinforcement learning. The method includes: obtaining operation state information of a heavy-haul train at a current time point; obtaining a heavy-haul train action of a next time point according to the operation state information of the heavy-haul train at the current time point and a heavy-haul train virtual controller, and sending the heavy-haul train action of the next time point to a heavy-haul train control unit to control operation of the heavy-haul train. The heavy-haul train virtual controller is obtained by training a reinforcement learning network according to operation state data of the heavy-haul train and an expert strategy network; the reinforcement learning network includes one actor network and two critic networks; the reinforcement learning network is constructed according to a soft actor-critic (SAC) reinforcement learning algorithm.


    Access

    Download


    Export, share and cite



    Title :

    Method and system for controlling heavy-haul train based on reinforcement learning


    Contributors:
    YANG HUI (author) / WANG YU (author) / LI ZHONGQI (author) / FU YATING (author) / TAN CHANG (author)

    Publication date :

    2021-12-21


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B61D Einzelheiten oder Arten des Wagenaufbaus von Eisenbahnfahrzeugen , BODY DETAILS OR KINDS OF RAILWAY VEHICLES / B61L Leiten des Eisenbahnverkehrs , GUIDING RAILWAY TRAFFIC / G05B Steuer- oder Regelsysteme allgemein , CONTROL OR REGULATING SYSTEMS IN GENERAL / G06K Erkennen von Daten , RECOGNITION OF DATA / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen



    Research on Energy-Saving Speed Curve of Heavy Haul Train Based on Reinforcement Learning

    Zhang, Wei / Sun, Xubin / Liu, Zhongtian et al. | IEEE | 2023


    Dynamic reinforcement learning enabled heavy haul train group cooperative control method and system, terminal and medium

    YU XIAOQUAN / LI WEI / REN WANWAN et al. | European Patent Office | 2024

    Free access

    HEAVY HAUL TRAIN TEST BENCH

    XIAO BALI / WU JIHENG / LIU WENJUN et al. | European Patent Office | 2024

    Free access

    Operation simulator of heavy haul train

    Li Zhi / Zheng Yong / Qiu Xiaogang | Tema Archive | 1989


    Train Scheduling for Heavy Haul Railway

    Wang, Pei / Zhang, Jie / Feng, Baoheng et al. | Springer Verlag | 2017