Deep reinforcement learning has been increasingly discussed for solving continuous control tasks in the field of autonomous driving and driver assistance systems. However, trial-and-error learning and the black-box character of neural networks make it prone to accidental damage in safety-critical environments. We propose to learn a safe vehicle following controller with deep reinforcement learning by imposing state-specific safe sets as output constraints on the policy and call the approach ACC 4S. The main safety goal is the avoidance of rear-end collisions with the front vehicle. To achieve this, we build on the Responsibility-Sensitive Safety model and derive an upper bound for the demanded acceleration. Further limitations emerge from regulatory standards and system limits. We end up with state-specific intervals of safe actions, the safe sets. To impose these safe sets as hard output constraints on the policy, we leverage the recently proposed neural network architecture ConstraintNet. We compare ConstraintNet with an unconstrained neural network, additional clipping as postprocessing, and clipping as part of the neural network. The results show, that the proposed safe sets ensure collision avoidance and ConstraintNet shows superior performance compared to the other approaches.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Safe Deep Reinforcement Learning for Adaptive Cruise Control by Imposing State-Specific Safe Sets


    Beteiligte:
    Brosowsky, Mathis (Autor:in) / Keck, Florian (Autor:in) / Ketterer, Jakob (Autor:in) / Isele, Simon (Autor:in) / Slieter, Daniel (Autor:in) / Zollner, Marius (Autor:in)


    Erscheinungsdatum :

    11.07.2021


    Format / Umfang :

    5568948 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    SAFE DEEP REINFORCEMENT LEARNING FOR ADAPTIVE CRUISE CONTROL BY IMPOSING STATE-SPECIFIC SAFE SETS

    Brosowsky, Mathis / Keck, Florian / Ketterer, Jakob et al. | British Library Conference Proceedings | 2021


    Safe cruise control method

    MA YULIN / ZHAO JUNPING / ZHAO FANFAN | Europäisches Patentamt | 2025

    Freier Zugriff

    Safe Reinforcement Learning for Urban Driving using Invariably Safe Braking Sets

    Krasowski, Hanna / Zhang, Yinqiang / Althoff, Matthias | IEEE | 2022


    CUT-IN-SAFE ADAPTIVE CRUISE CONTROL SYSTEM FOR VEHICLES

    ALTHOFF MATTHIAS / MAIERHOFER SEBASTIAN / PEK CHRISTIAN | Europäisches Patentamt | 2021

    Freier Zugriff

    CUT-IN-SAFE ADAPTIVE CRUISE CONTROL SYSTEM FOR VEHICLES

    ALTHOFF MATTHIAS / MAIERHOFER SEBASTIAN / PEK CHRISTIAN | Europäisches Patentamt | 2024

    Freier Zugriff