Reinforcement Learning is a promising method for automated tuning of controllers, but is yet rarely applied to real systems like longitudinal vehicle control, since it struggles in the face of real-time tasks, noise, partially observed dynamics and delays. We propose a model-based reinforcement learning algorithm for the task of speed tracking control on constrained hardware. In order to cope with partially observed dynamics, delay and noise our algorithm relies on an autoregressive model with external inputs (ARX model) that is learned using a decaying step size. The output controller is updated by policy search on the learned model. Multiple experiments show that the proposed algorithm is capable of learning a controller in a real vehicle in different speed ranges and with a variety of exploration noise distribution and amplitudes. The results show that the proposed approach yields similar results to a recently published model-free reinforcement learning method in most conditions, e.g, when adapting the controller to very low speeds, but succeeds to learn with a wider variety of exploration noise types.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Speed Tracking Control Using Model-Based Reinforcement Learning in a Real Vehicle


    Beteiligte:
    Puccetti, Luca (Autor:in) / Yasser, Ahmed (Autor:in) / Rathgeber, Christian (Autor:in) / Becker, Andreas (Autor:in) / Hohmann, Soren (Autor:in)


    Erscheinungsdatum :

    2021-07-11


    Format / Umfang :

    516921 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    SPEED TRACKING CONTROL USING MODEL-BASED REINFORCEMENT LEARNING IN A REAL VEHICLE

    Puccetti, Luca / Yasser, Ahmed / Rathgeber, Christian et al. | British Library Conference Proceedings | 2021


    Vehicle following speed control method based on deep reinforcement learning

    FEI RONG / YANG LU / QIU YUAN et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    FRCNN-Based Reinforcement Learning for Real-Time Vehicle Detection, Tracking and Geolocation from UAS

    Chandra Has Singh / Vishal Mishra / Kamal Jain et al. | DOAJ | 2022

    Freier Zugriff

    Reinforcement Learning for Speed Control with Feedforward to Track Velocity Profiles in a Real Vehicle

    Kopf, Florian / Puccetti, Luca / Rathgeber, Christian et al. | IEEE | 2020


    A Real-Time Intelligent Speed Optimization Planner Using Reinforcement Learning

    Rousseau, Aymeric / Karbowski, Dominik / Han, Jihun et al. | SAE Technical Papers | 2021