With the rapid advancement of autonomous vehicle technology, the development of efficient and stable trajectory tracking algorithms is crucial for achieving autonomous navigation. This paper addresses the issue of insufficient stability in traditional MPC for vehicle trajectory tracking and proposes a Q-learning-based multi-step model predictive control (QM-MPC) algorithm. This algorithm integrates the principles of model predictive control and reinforcement learning to accurately predict the future motion trajectory of autonomous vehicles using MPC. Furthermore, it utilizes Q-learning to perform multi-step deep predictions on the MPC-predicted motion trajectory results and propagates these deep predictions back to the current state. Through this approach, the objective cost function of MPC for autonomous vehicles is optimized, thereby further enhancing the efficiency and stability of trajectory tracking. Experimental results demonstrate that the proposed QM-MPC algorithm exhibits robust stability of Unmanned Ground Vehicle (UGV) in trajectory tracking. Specifically, it significantly enhances stability by 4.303%, 61.965%, 51.481% and 39.024% in path deviation, convergence time, yaw angle deviation and yaw rate, respectively. These findings underscore its considerable utility in autonomous vehicle navigation.
Q-Learning-Based Multi-step Model Predictive Control (QM-MPC) for UGVs Trajectory Tracking
Lect. Notes Electrical Eng.
International Conference on Autonomous Unmanned Systems ; 2024 ; Shenyang, China September 19, 2024 - September 21, 2024
Proceedings of 4th 2024 International Conference on Autonomous Unmanned Systems (4th ICAUS 2024) ; Kapitel : 16 ; 162-171
22.03.2025
10 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
UAV–UGVs cooperation: With a moving center based trajectory
Tema Archiv | 2015
|SPIE | 1996
|UAV Trajectory Tracking Based on Model Predictive Control
Springer Verlag | 2025
|DOAJ | 2024
|