Reinforcement Learning (RL) can enhance the adjustment of the traffic signals' phases to improve the traffic flow. RL methods use ontologies and reasoning to enrich the controllers' domain knowledge, enabling them to interpret the traffic data, and ultimately improving their performance. Various RL methods are proposed for signal controllers with assumptions such as operating in non-stochastic environments with a predictable traffic flow and observing the fine-grained information of all vehicles. Such methods have not examined the robustness of the trained RL controllers' action selection when deployed in dynamic environments with partial detection of vehicles. However, in the real world, not all vehicles can be detectable, and not all events can be predicted. In this paper, we propose an Ontology-based Intelligent Traffic Signal Control (OITSC) model that augments the RL controllers' observation using an environment ontology model, which improves their action selection particularly in dynamic, partially observable environments with stochastic traffic flow. The decreased vehicles' waiting time in various traffic scenarios with partial detection of vehicles, noisy sensor data, and unexpected traffic events shows that the performance of the controllers is significantly improved in all tested RL algorithms (i.e., Q-learning, SARSA, and Deep Q-Network).


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An Ontology-Based Intelligent Traffic Signal Control Model


    Contributors:


    Publication date :

    2021-09-19


    Size :

    1470684 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Intelligent traffic signal control method based on pipeline model

    WU LIBING / NIE LEI / PENG HONGMEI et al. | European Patent Office | 2015

    Free access

    Intelligent traffic intelligent signal control method

    PEI CHUNHONG / FENG QIANG | European Patent Office | 2023

    Free access

    Ontology-Based Information Retrieval for City Intelligent Public Traffic

    Yang, Xiaojia / Zhai, Jun / Chen, Yan | ASCE | 2007


    Ontology-Based Information Retrieval for City Intelligent Public Traffic

    Yang, X. / Zhai, J. / Chen, Y. et al. | British Library Conference Proceedings | 2007


    Intelligent traffic signal control cabinet

    SHU SHAOHUI / XIE WENBIN / JI YI et al. | European Patent Office | 2022

    Free access