Ramp metering (RM) is the most effective dynamic traffic measure in response to growing congestion in urban freeway networks. Among the extensive RM methods available, those based on optimal control theory have shown strong potential in improving freeway performance. However, these algorithms require an accurate traffic model that limits their applicability in practice. Reinforcement learning (RL) provides the tools to achieve optimal RM control without reliance on any traffic model. In this paper, a guideline for designing RM control systems based on RL is presented by testing different states’ representations, learning methods, action selection, and reward definitions. A microscopic simulation test bed based on a portion of Highway 401 in Toronto, Canada, is developed to evaluate each of the above design parameters and quantify various RM control strategies. A comparison of the reinforcement learning ramp-metering (RLRM) algorithm with a modified version of ALINEA shows the potential of RLRM to improve freeway traffic conditions. When applied to the developed case study, the proposed RLRM algorithm and modified ALINEA reduce the total travel time by 40% and 20%, respectively, compared with the case with no RM.


    Access

    Download

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Self-Learning Adaptive Ramp Metering


    Subtitle :

    Analysis of Design Parameters on a Test Case in Toronto, Canada


    Additional title:

    Transportation Research Record


    Contributors:


    Publication date :

    2013-01-01




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Ramp Metering

    Gordon, Robert | Springer Verlag | 2016


    Using SCATS Adaptive Coordinated Ramp Metering Algorithm

    O Brien, A. P. / McCombs, P. / Institute of Transportation Engineers | British Library Conference Proceedings | 2007


    Ramp metering based on adaptive critic designs

    Jing Xu, / Wen-Sheng Yu, / Fei-Yue Wang, | IEEE | 2006


    Ramp Adaptive Metering Bottleneck Optimization (RAMBO) User's Manual

    C. J. Messer / M. E. Thomadakis / H. A. Charara et al. | NTIS | 1994


    A flow-maximizing adaptive local ramp metering strategy

    Smaragdis, Emmanouil | Online Contents | 2004