The management of mixed traffic that consists of robot vehicles (RVs) and human-driven vehicles (HVs) at complex intersections presents a multifaceted challenge. Traditional signal controls often struggle to adapt to dynamic traffic conditions and heterogeneous vehicle types. Recent advancements have turned to strategies based on reinforcement learning (RL), leveraging its model-free nature, real-time operation, and generalizability over different scenarios. We introduce a hierarchical RL framework to manage mixed traffic through precise longitudinal and lateral control of RVs. Our proposed hierarchical framework combines the state-of-the-art mixed traffic control algorithm as a high level decision maker to improve the performance and robustness of the whole system. Our experiments demonstrate that the framework can reduce the average waiting time by up to 54% compared to the state-of-the-art mixed traffic control method. When the RV penetration rate exceeds 60%, our technique consistently outperforms conventional traffic signal control programs in terms of the average waiting time for all vehicles at the intersection.


    Access

    Download


    Export, share and cite



    Title :

    Learning to Change: Choreographing Mixed Traffic Through Lateral Control and Hierarchical Reinforcement Learning


    Contributors:
    Wang, Dawei (author) / Li, Weizi (author) / Zhu, Lei (author) / Pan, Jia (author)

    Publication date :

    2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English





    Hierarchical Reinforcement Learning Under Mixed Observability

    Nguyen, Hai / Yang, Zhihan / Baisero, Andrea et al. | TIBKAT | 2023


    Hierarchical Reinforcement Learning Under Mixed Observability

    Nguyen, Hai / Yang, Zhihan / Baisero, Andrea et al. | Springer Verlag | 2022



    TRAFFIC CONTROL WITH REINFORCEMENT LEARNING

    GANTI RAGHU KIRAN / SRIVASTA MUDHAKAR / RAO VENKATESH ASHOK RAO et al. | European Patent Office | 2020

    Free access