Lane-merging scenarios pose highly challenging problems for autonomous vehicles due to conflicts of interest between the human-driven and cutting-in autonomous vehicles. Such conflicts become severe when traffic increases, and cut-in algorithms suffer from a steep trade-off between safety and cut-in performance. In this study, a reinforcement learning (RL)-based cut-in policy network nested within a finite state machine (FSM)—which is a high-level decision maker, is proposed to achieve high cut-in performance without sacrificing safety. This FSM-RL hybrid approach is proposed to obtain 1) a strategic and adjustable algorithm, 2) optimal safety and cut-in performance, and 3) robust and consistent performance. In the high-level decision making algorithm, the FSM provides a framework for four cut-in phases (ready for safe gap selection, gap approach, negotiation, and lane-change execution) and handles the transitions between these phases by calculating the collision risks associated with target vehicles. For the lane-change phase, a policy-based deep-RL approach with a soft actor–critic network is employed to get optimal cut-in performance. The results of simulations show that the proposed FSM-RL cut-in algorithm consistently achieves a high cut-in success rate without sacrificing safety. In particular, as the traffic increases, the cut-in success rate and safety are significantly improved over existing optimized rule-based cut-in algorithms and end-to-end RL algorithm.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Autonomous Vehicle Cut-In Algorithm for Lane-Merging Scenarios via Policy-Based Reinforcement Learning Nested Within Finite-State Machine


    Beteiligte:
    Hwang, Seulbin (Autor:in) / Lee, Kibeom (Autor:in) / Jeon, Hyeongseok (Autor:in) / Kum, Dongsuk (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.10.2022


    Format / Umfang :

    4197716 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Lane-Merging Using Policy-based Reinforcement Learning and Post-Optimization

    Hart, Patrick / Rychly, Leonard / Knoll, Alois | IEEE | 2019


    System For Autonomous Lane Merging

    LIKHACHEV MAXIM / RATNER ELLIS MARSHAL / LYU LU et al. | Europäisches Patentamt | 2019

    Freier Zugriff

    System for autonomous lane merging

    LIKHACHEV MAXIM / RATNER ELLIS MARSHAL / LYU LU et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    Temporal Based Deep Reinforcement Learning for Crowded Lane Merging Maneuvers

    Martinez Gomez, Luis Miguel / Daza, Ivan Garcia / Sotelo Vazquez, Miguel Angel | IEEE | 2023


    Autonomous lane merging system and method

    MEI AOHAN / ZHANG CHEN / WANG FAN | Europäisches Patentamt | 2023

    Freier Zugriff