Reinforcement Learning (RL) can enhance the adjustment of the traffic signals' phases to improve the traffic flow. RL methods use ontologies and reasoning to enrich the controllers' domain knowledge, enabling them to interpret the traffic data, and ultimately improving their performance. Various RL methods are proposed for signal controllers with assumptions such as operating in non-stochastic environments with a predictable traffic flow and observing the fine-grained information of all vehicles. Such methods have not examined the robustness of the trained RL controllers' action selection when deployed in dynamic environments with partial detection of vehicles. However, in the real world, not all vehicles can be detectable, and not all events can be predicted. In this paper, we propose an Ontology-based Intelligent Traffic Signal Control (OITSC) model that augments the RL controllers' observation using an environment ontology model, which improves their action selection particularly in dynamic, partially observable environments with stochastic traffic flow. The decreased vehicles' waiting time in various traffic scenarios with partial detection of vehicles, noisy sensor data, and unexpected traffic events shows that the performance of the controllers is significantly improved in all tested RL algorithms (i.e., Q-learning, SARSA, and Deep Q-Network).
An Ontology-Based Intelligent Traffic Signal Control Model
2021-09-19
1470684 byte
Conference paper
Electronic Resource
English
Intelligent traffic signal control method based on pipeline model
European Patent Office | 2015
|Ontology-Based Information Retrieval for City Intelligent Public Traffic
British Library Conference Proceedings | 2007
|