This paper proposes a trajectory tracking control framework for two degrees of freedom (2-DOF) Unmanned Ground Vehicle (UGV) based on Deep Reinforcement Learning (DRL). The Stanley algorithm is used to estimate the initial control inputs of the vehicle, then the DRL adjusts the control inputs to precisely follow a predefined trajectory. The Double Deep Q-Network (DDQN) algorithm, which is a type of DRL, is used to get the best policy during the training task. Two approaches are used during the training process; one approach is based on the yaw error, and the other is based on the yaw and distance errors between the vehicle's path and the trajectory. Two Neural Networks (NNs) are used in the proposed control framework; the target network is used to estimate the future rewards, and the critic network is used to serve as a controller to generate the controls' actions of the vehicle. The proposed control framework is validated through a series of simulations, where the 2-DOF UGV is traveling at 1 m/s, 2m/ s, and 5 m/s on an elliptical track with ~ 420 m in length to evaluate the proposed control framework. The simulation results show that the proposed control framework increases the accuracy of trajectory tracking by ~ 64%. A comparison between the Stanley-based DDQN and the Stanley method alone shows that the Stanley-based DDQN constitutes a robust framework to achieve accurate and adaptive trajectory tracking for high-precision navigation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Reinforcement Learning for Precision Navigation: DDQN-Based Trajectory Tracking in Unmanned Ground Vehicles


    Beteiligte:
    Hassan, Islam A. (Autor:in) / Ragheb, H. (Autor:in) / Sharaf, A. M. (Autor:in) / Attia, Tamer (Autor:in)


    Erscheinungsdatum :

    21.05.2024


    Format / Umfang :

    789563 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Trajectory Tracking and Navigation Model for Autonomous Vehicles Using Reinforcement Learning

    Ramani, G. / Karthik, C. / Pranay, B. et al. | Springer Verlag | 2024


    Deep Reinforcement Learning for Mapless Navigation of Unmanned Aerial Vehicles

    Grando, Ricardo B. / de Jesus, Junior C. / Drews-Jr, Paulo L. J. | IEEE | 2020


    Intersection navigation for unmanned ground vehicles

    Larsen, Karin R. / Olson, Keith | SPIE | 1996


    Autonomous road navigation for unmanned ground vehicles

    Speigle, Scott A. / McIngvale, Pat / Olson, Keith et al. | SPIE | 1995


    Optimal Rendezvous Trajectory for Unmanned Aerial-Ground Vehicles

    Rucco, Alessandro / Sujit, P. B. / Aguiar, A. Pedro et al. | IEEE | 2018