This paper proposes a new approach of using reinforcement learning (RL) to train an agent to perform the task of vehicle following with human driving characteristics. We refer to the ideal of inverse reinforcement learning to design the reward function of the RL model. The factors that need to be weighed in vehicle following were vectorized into reward vectors, and the reward function was defined as the inner product of the reward vector and weights. Driving data of human drivers was collected and analyzed to obtain the true reward function. The RL model was trained with the deterministic policy gradient algorithm because the state and action spaces are continuous. We adjusted the weight vector of the reward function so that the value vector of the RL model could continuously approach that of a human driver. After dozens of rounds of training, we selected the policy with the nearest value vector to that of a human driver and tested it in the PanoSim simulation environment. The results showed the desired performance for the task of an agent following the preceding vehicle safely and smoothly.
Preceding vehicle following algorithm with human driving characteristics
2021-06-01
10 pages
Article (Journal)
Electronic Resource
English
European Patent Office | 2017
|A New Car-Following Model considering Driving Characteristics and Preceding Vehicle’s Acceleration
DOAJ | 2017
|European Patent Office | 2021
|DRIVERS' CAR-FOLLOWING CORRELATIVE BEHAVIOR WITH PRECEDING VEHICLES IN MULTILANE DRIVING
British Library Conference Proceedings | 2014
|European Patent Office | 2021
|