In this study, we develop a stochastic dynamic traffic-flow model subject to practical restrictions under the non-homogeneous Poisson vehicle arrival process. Using the cell transmission strategy, we establish traffic dynamics between two intersections. We also discuss simulating the random demand of source links from an estimated intensity function. Additionally, we propose an algorithm to optimize time interval division for aggregated data, aiming to enhance estimation performance. We explore applying our traffic flow model to the adaptive traffic network management problem, which is formulated as a Markov decision process. Leveraging approximate dynamic programming with recursive least squares-temporal difference learning, we achieve adaptive optimal policies. To validate our approach, we conduct a series of numerical experiments with random demands. The results of non-homogeneous Poisson demand conducted using random numbers and a real-word dataset indicate high efficiency with the piecewise constant, I-SMOOTH, and MNO-PQRS estimators. Compared to the Webster and Max-pressure control systems, our proposed approximate dynamic programming-based model exhibits superior stability and applicability.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptive network traffic control with approximate dynamic programming based on a non-homogeneous Poisson demand model


    Additional title:

    TRANSPORTMETRICA B
    S. Chen and X. Lü


    Contributors:
    Chen, Siqi (author) / Lü, Xing (author)


    Publication date :

    2024-12-31


    Size :

    30 pages




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English






    Adaptive traffic signal control using approximate dynamic programming

    Cai, C. / Wong, C.K. / Heydecker, B.G. | BASE | 2009

    Free access

    Traffic network micro‐simulation model and control algorithm based on approximate dynamic programming

    Yin, Biao / Dridi, Mahjoub / El Moudni, Abdellah | Wiley | 2016

    Free access

    Adaptive signal control using approximate dynamic programming

    Cai, C. / Heydecker, B. | BASE | 2009

    Free access