For highly automated driving above SAE level 3, behavior generation algorithms must reliably consider the inherent uncertainties of the traffic environment, e.g. arising from the variety of human driving styles. Such uncertainties can generate ambiguous decisions, requiring the algorithm to appropriately balance low-probability hazardous events, e.g. collisions, and high-probability beneficial events, e.g. quickly crossing the intersection. State-of-the-art behavior generation algorithms lack a distributional treatment of decision outcome. This impedes a proper risk evaluation in ambiguous situations, often encouraging either unsafe or conservative behavior. Thus, we propose a two-step approach for risk-sensitive behavior generation combining offline distribution learning with online risk assessment. Specifically, we first learn an optimal policy in an uncertain environment with Deep Distributional Reinforcement Learning. During execution, the optimal risk-sensitive action is selected by applying established risk criteria, such as the Conditional Value at Risk, to the learned state-action return distributions. In intersection crossing scenarios, we evaluate different risk criteria and demonstrate that our approach increases safety, while maintaining an active driving style. Our approach shall encourage further studies about the benefits of risk-sensitive approaches for self-driving vehicles.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Addressing Inherent Uncertainty: Risk-Sensitive Behavior Generation for Automated Driving using Distributional Reinforcement Learning


    Beteiligte:
    Bernhard, Julian (Autor:in) / Pollok, Stefan (Autor:in) / Knoll, Alois (Autor:in)


    Erscheinungsdatum :

    01.06.2019


    Format / Umfang :

    1315607 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    ADDRESSING INHERENT UNCERTAINTY: RISK-SENSITIVE BEHAVIOR GENERATION FOR AUTOMATED DRIVING USING DISTRIBUTIONAL REINFORCEMENT LEARNING

    Bernhard, Julian / Pollok, Stefan / Knoll, Alois | British Library Conference Proceedings | 2019


    Distributional Reinforcement Learning For Automated Driving Vehicle

    Naveen, A M / Ravish, Roopa / Ranga Swamy, Shanta | IEEE | 2022


    Uncertainty-Driven Distributional Reinforcement Learning for Flight Control

    Homola, Marek / Li, Yifei / Van Kampen, Erik-Jan | AIAA | 2025


    Minimizing Safety Interference for Safe and Comfortable Automated Driving with Distributional Reinforcement Learning

    Kamran, Danial / Engelgeh, Tizian / Busch, Marvin et al. | DataCite | 2021

    Freier Zugriff