We propose for the first time two reinforcement learning algorithms with function approximation for average cost adaptive control of traffic lights. One of these algorithms is a version of Q-learning with function approximation while the other is a policy gradient actor-critic algorithm that incorporates multi-timescale stochastic approximation. We show performance comparisons on various network settings of these algorithms with a range of fixed timing algorithms, as well as a Q-learning algorithm with full state representation that we also implement. We observe that whereas (as expected) on a two-junction corridor, the full state representation algorithm shows the best results, this algorithm is not implementable on larger road networks. The algorithm PG-AC-TLC that we propose is seen to show the best overall performance.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement learning with average cost for adaptive control of traffic lights at intersections


    Beteiligte:
    Prashanth, L. A. (Autor:in) / Bhatnagar, S. (Autor:in)


    Erscheinungsdatum :

    01.10.2011


    Format / Umfang :

    597887 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Reduction of BRT delays at highway intersections through adaptive traffic lights control

    Brena, Andy / Vasquez, Junior / Silvera, Manuel et al. | IEEE | 2022



    Traffic Lights Control Using Reinforcement Learning: A Comparative Study

    Errajraji, Khalid / Bouayad, Anas / Fardousse, Khalid | Springer Verlag | 2024


    Adaptive Traffic Signal Control Model on Intersections Based on Deep Reinforcement Learning

    Duowei Li / Jianping Wu / Ming Xu et al. | DOAJ | 2020

    Freier Zugriff

    Automated Crossing of Intersections Controlled by Traffic Lights

    Mazzalai, Alessandro / Biral, Francesco / Lio, Mauro Da et al. | IEEE | 2015