Reinforcement Learning (RL) has been proposed to deal with ramp control problems under dynamic traffic conditions; however, there is a lack of sufficient research on the behaviour and impacts of different learning parameters. This paper describes a ramp control agent based on the RL mechanism and thoroughly analyzed the influence of three learning parameters; namely, learning rate, discount rate and action selection parameter on the algorithm performance. Two indices for the learning speed and convergence stability were used to measure the algorithm performance, based on which a series of simulation-based experiments were designed and conducted by using a macroscopic traffic flow model. Simulation results showed that, compared with the discount rate, the learning rate and action selection parameter made more remarkable impacts on the algorithm performance. Based on the analysis, some suggestions about how to select suitable parameter values that can achieve a superior performance were provided.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning for Ramp Control: An Analysis of Learning Parameters


    Beteiligte:
    Chao Lu (Autor:in) / Jie Huang (Autor:in) / Jianwei Gong (Autor:in)


    Erscheinungsdatum :

    2016




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    Reinforcement Learning Control for On-Ramp Metering Based on Traffic Simulation

    Wang, X. / Liu, B. / Niu, X. et al. | British Library Conference Proceedings | 2009


    Learning Highway Ramp Merging Via Reinforcement Learning with Temporally-Extended Actions

    Triest, Samuel / Villaflor, Adam / Dolan, John M. | IEEE | 2020


    Multi-ramp coordination control method based on different strategy reinforcement learning

    HAN YU / GAO JINDA / LI LINGHUI et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    Vehicle ramp entrance confluence control method based on deep reinforcement learning

    TONG NING / LI FENGQI / WANG KUNRUI | Europäisches Patentamt | 2023

    Freier Zugriff

    Combining Reinforcement Learning with Model Predictive Control for On-Ramp Merging

    Lubars, Joseph / Gupta, Harsh / Chinchali, Sandeep et al. | IEEE | 2021