Reinforcement Learning is a promising method for automated tuning of controllers, but is yet rarely applied to real systems like longitudinal vehicle control, since it struggles in the face of real-time tasks, noise, partially observed dynamics and delays. We propose a model-based reinforcement learning algorithm for the task of speed tracking control on constrained hardware. In order to cope with partially observed dynamics, delay and noise our algorithm relies on an autoregressive model with external inputs (ARX model) that is learned using a decaying step size. The output controller is updated by policy search on the learned model. Multiple experiments show that the proposed algorithm is capable of learning a controller in a real vehicle in different speed ranges and with a variety of exploration noise distribution and amplitudes. The results show that the proposed approach yields similar results to a recently published model-free reinforcement learning method in most conditions, e.g, when adapting the controller to very low speeds, but succeeds to learn with a wider variety of exploration noise types.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Speed Tracking Control Using Model-Based Reinforcement Learning in a Real Vehicle


    Contributors:


    Publication date :

    2021-07-11


    Size :

    516921 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    SPEED TRACKING CONTROL USING MODEL-BASED REINFORCEMENT LEARNING IN A REAL VEHICLE

    Puccetti, Luca / Yasser, Ahmed / Rathgeber, Christian et al. | British Library Conference Proceedings | 2021


    Vehicle following speed control method based on deep reinforcement learning

    FEI RONG / YANG LU / QIU YUAN et al. | European Patent Office | 2023

    Free access

    FRCNN-Based Reinforcement Learning for Real-Time Vehicle Detection, Tracking and Geolocation from UAS

    Chandra Has Singh / Vishal Mishra / Kamal Jain et al. | DOAJ | 2022

    Free access

    Reinforcement Learning for Speed Control with Feedforward to Track Velocity Profiles in a Real Vehicle

    Kopf, Florian / Puccetti, Luca / Rathgeber, Christian et al. | IEEE | 2020


    A Real-Time Intelligent Speed Optimization Planner Using Reinforcement Learning

    Rousseau, Aymeric / Karbowski, Dominik / Han, Jihun et al. | SAE Technical Papers | 2021