Merging in congested freeway traffic is a significant challenge toward realizing fully automated (level 4) driving. Merging vehicles need to decide not only how to merge safely into a spot, but also where to merge. We present a method for freeway merge based on multipolicy decision making coupled with a reinforcement learning technique called passive actor-critic (pAC), which learns with less knowledge of the system and without active exploration. The multipolicy decision making selects a candidate spot for merging by using the state value learned by pAC. Together, these techniques yield a method that first decides where to merge and then realizes safe merging. We evaluate our method using real traffic data. Our experiments show that pAC achieves an overall success rate of 92% for merging into a predetermined spot on a freeway, which is comparable to human decision making.
Merging in Congested Freeway Traffic Using Multipolicy Decision Making and Passive Actor-Critic Learning
IEEE Transactions on Intelligent Vehicles ; 4 , 2 ; 287-297
2019-06-01
3584495 byte
Article (Journal)
Electronic Resource
English
Freeway Merging in Congested Traffic based on Multipolicy Decision Making with Passive Actor Critic
ArXiv | 2017
|Observing Freeway Ramp Merging Phenomena in Congested Traffic
Online Contents | 2007
|Microsimulation of Freeway Ramp Merging Processes Under Congested Traffic Conditions
Online Contents | 2007
|Improving the efficiency of freight traffic at congested freeway merging sections
Taylor & Francis Verlag | 2009
|