The active pantograph is a promising technology to suppress contact force (CF) fluctuation in pantograph–catenary systems (PCSs). Recently, the rapid development of reinforcement learning (RL) techniques has dramatically facilitated complex system controllers’ design. However, the low data efficiency problem is fatal because data collection is costly. In this article, we propose the ensemble Q-functions model-based RL (EQ-MBRL) algorithm to achieve data-efficient RL. First, we introduce an ensemble probabilistic neural network (EPNN) to estimate the distribution and uncertainty of the dynamics model and adopt multistep loss to constrain the accumulation error in the long-length model rollout. Second, we employ a short-term rollout of the model to trade off the ease of data generation and the error of the model-generated data. Finally, we propose ensemble Q-functions and in-target minimization techniques to help stabilize the training process of value functions and improve the accuracy of value estimation. In addition, we discussed the appropriate model-based rollout length and explored the performance of network update rates with different strategies. The experimental results demonstrate that the proposed approach outperforms compared algorithms and delivers a state-of-the-art performance on the PCS benchmark. The controller learned robust motion patterns using only 50k collected transitions, which was more than ten times faster than compared baseline.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Model-Based Data-Efficient Reinforcement Learning for Active Pantograph Control in High-Speed Railways


    Beteiligte:
    Wang, Hui (Autor:in) / Liu, Zhigang (Autor:in) / Wang, Xufan (Autor:in) / Meng, Xiangyu (Autor:in) / Wu, Yanbo (Autor:in) / Han, Zhiwei (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2024-06-01


    Format / Umfang :

    3343486 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Estimator-based multiobjective robust control strategy for an active pantograph in high-speed railways

    Lu, Xiaobing / Liu, Zhigang / Song, Yang et al. | SAGE Publications | 2018


    High speed railways: pantograph and overhead line modelling and simulation

    Diana, G. / Bruni, S. / Collina, A. et al. | British Library Conference Proceedings | 1998


    High speed railways: pantograph and overhead lines modelling and simulation

    Diana, G. / Bruni, S. / Collina, A. et al. | Tema Archiv | 1998


    Multifunctional high-speed pantograph auxiliary pantograph lifting device

    MA DEBIAO / SU ANSHE / YU JINPENG et al. | Europäisches Patentamt | 2020

    Freier Zugriff