Reinforcement Learning is proving a successful tool that can manage urban intersections with a fraction of the effort required to curate traditional traffic controllers. However, literature on the simultaneous introduction and control of pedestrians to such intersections is very scarce. Furthermore, it is unclear what traffic state variables should be used as reward to minimise waiting times. This paper robustly evaluates 30 different Reinforcement Learning reward functions for controlling a real-world intersection serving pedestrians and vehicles covering the main traffic state variables available via modern vision-based sensors. Some rewards proposed in previous literature solely for vehicular traffic are extended to pedestrians while new ones are proposed. We use a calibrated model in terms of demand, sensors, green times and other operational constraints of a real intersection in Greater Manchester, UK, to which the agent has been since deployed. The assessed rewards can be classified in 5 groups depending on the quantities used: queues, waiting time, delay, average speed and throughput in the junction. The performance of different agents, in terms of waiting time, is compared across different demand levels, from normal operation to saturation of traditional adaptive controllers. We find that those rewards maximising the speed of the network obtain the lowest waiting time for vehicles and pedestrians simultaneously, closely followed by queue minimisation, demonstrating better performance than other previously proposed methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Assessment of Reward Functions in Reinforcement Learning for Multi-Modal Urban Traffic Control under Real-World limitations*


    Beteiligte:


    Erscheinungsdatum :

    2021-09-19


    Format / Umfang :

    993983 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Reward Function Design in Multi-Agent Reinforcement Learning for Traffic Signal Control

    Koohy, Behrad / Stein, Sebastian / Gerding, Enrico et al. | TIBKAT | 2022

    Freier Zugriff

    Decentralized signal control for multi-modal traffic network: A deep reinforcement learning approach

    Yu, Jiajie / Laharotte, Pierre-Antoine / Han, Yu et al. | Elsevier | 2023


    Adaptive traffic signal control system using composite reward architecture based deep reinforcement learning

    Jamil, Abu Rafe Md / Ganguly, Kishan Kumar / Nower, Naushin | IET | 2021

    Freier Zugriff

    Adaptive traffic signal control system using composite reward architecture based deep reinforcement learning

    Jamil, Abu Rafe Md / Ganguly, Kishan Kumar / Nower, Naushin | Wiley | 2020

    Freier Zugriff

    Reward functions for learning to control in air traffic flow management

    Cruciol, Leonardo L.B.V. | Online Contents | 2013