The sparse reward in traditional reinforcement learning will lead to poor training effect of autonomous vehicles. This paper proposes a hierarchical automatic driving decision method based on reinforcement learning. The multi-modal fusion of camera images and radar data ensures the state input of autonomous vehicles. The action space is divided into high-level options and low-level actions. The high-level option network and the underlying action network are built respectively. The vehicle interacts with the environment to learn the optimal driving strategy. Through simulation experiments, compared with DDDQN and DQN algorithms, the average speed of autonomous vehicles based on HDDDQN increases by about 4.48%, the average number of lane changes decreases by about 4.54%, and the average number of overtaking increases by about 18.6 %. Therefore, the safety and driving efficiency of automatic driving are significantly improved.
Autonomous Driving Decision Algorithm based on Hierarchical Dueling Double Deep Q-Network
2024-09-20
1192083 byte
Conference paper
Electronic Resource
English
Dueling Deep Q Network for Highway Decision Making in Autonomous Vehicles: A Case Study
ArXiv | 2020
|Research on Dueling Double Deep Q Network Algorithm Based on Single-Step Momentum Update
Transportation Research Record | 2023
|An improved Dueling Deep Q-network with optimizing reward functions for driving decision method
SAGE Publications | 2023
|