The invention provides a train temporary parking strategy optimization method based on deep reinforcement learning. The train temporary parking strategy optimization method is characterized in that an environment module, a knowledge module, an experience playback pool and a plurality of agents are included; the optimization method comprises the following steps: the knowledge module distributes a temporary stop instruction sequence to each agent; each agent interacts with the environment module by adopting an Actor-Critic algorithm to obtain a temporary stop time sequence and an experience array; empirical arrays obtained by the intelligent agents are all put into an empirical playback pool; and after the experience playback pool is fully loaded, each agent randomly extracts an experience array from the experience playback pool to update the corresponding strategy network parameters and value network parameters. By the adoption of the method, the optimization speed and quality of the train temporary stop strategy are improved, and then the train temporary stop accuracy and riding comfort are improved.

    本发明提供了一种基于深度强化学习的列车临时停车策略的优化方法,其特征在于:包括环境模块、知识模块、经验回放池和多个智能体;所述优化方法包括:所述知识模块将临停指令序列分发给各个智能体;各个智能体均采用Actor‑Critic算法与环境模块交互以获取临停时间序列和经验数组;将各个智能体获取的经验数组均放入经验回放池;当经验回放池满载后,各个智能体均从经验回放池中随机抽取经验数组对各自对应的策略网络参数和价值网络参数进行更新。采用本发明的方法提高了列车临停策略的优化速度和质量,进而提高了列车临停的准确度和乘坐舒适性。


    Access

    Download


    Export, share and cite



    Title :

    Train temporary parking strategy optimization method based on deep reinforcement learning


    Additional title:

    基于深度强化学习的列车临时停车策略的优化方法


    Contributors:
    XU KAI (author) / ZHANG HAOTONG (author) / HUANG DEQING (author) / HE DEQIANG (author) / WU SHIXUN (author) / LAN ZHANGLI (author) / YANG JIANXI (author) / YANG TONGRUI (author)

    Publication date :

    2023-08-18


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    Chinese


    Classification :

    IPC:    G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06Q Datenverarbeitungssysteme oder -verfahren, besonders angepasst an verwaltungstechnische, geschäftliche, finanzielle oder betriebswirtschaftliche Zwecke, sowie an geschäftsbezogene Überwachungs- oder Voraussagezwecke , DATA PROCESSING SYSTEMS OR METHODS, SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL, SUPERVISORY OR FORECASTING PURPOSES / G08G Anlagen zur Steuerung, Regelung oder Überwachung des Verkehrs , TRAFFIC CONTROL SYSTEMS



    Train accurate parking control method based on deep reinforcement learning

    ZHANG LEI / ZHANG JIANGUO | European Patent Office | 2022

    Free access

    Deep reinforcement learning method suitable for automatic parking of high-speed train

    LIANG DONGYUE / CUI YUJUN / YANG WEIHUA et al. | European Patent Office | 2022

    Free access

    Train operation scheduling optimization method based on deep reinforcement learning

    LI LIJUAN / YANG XUE / WANG HUAN et al. | European Patent Office | 2023

    Free access

    Train Regenerative Braking Strategy Optimization Based on Reinforcement Learning

    Zeng, Xiaoqing / Liu, Liqun / Yuan, Tengfei | Springer Verlag | 2023


    Automatic parking method based on deep reinforcement learning

    LONG QIANG / TAO SHUNBO | European Patent Office | 2020

    Free access