Perimeter control maintains high traffic efficiency within protected regions by controlling transfer flows among regions to ensure that their traffic densities are below critical values. Existing approaches can be categorized as either model-based or model-free, depending on whether they rely on network transmission models (NTMs) and macroscopic fundamental diagrams (MFDs). Although model-based approaches are more data efficient and have performance guarantees, they are inherently prone to model bias and inaccuracy. For example, NTMs often become imprecise for a large number of protected regions, and MFDs can exhibit scatter and hysteresis that are not captured in existing model-based works. Moreover, no existing studies have employed reinforcement learning for homogeneous flow rate optimization in microscopic simulation, where spatial characteristics, vehicle-level information, and metering realizations - often overlooked in macroscopic simulations - are taken into account. To circumvent issues of model-based approaches and macroscopic simulation, we explore a model-free deep reinforcement learning approach that optimizes the flow rate homogeneously at the perimeter at the microscopic level. Additionally, we investigate different arrangements of the agent's state space to assess the importance of different state variables. Results demonstrate that the model-free reinforcement learning approach without any knowledge of NTMs or MFDs can compete and match the performance of a model-based approach, and exhibits enhanced generalizability and scalability.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Perimeter Control Using Deep Reinforcement Learning: A Model-Free Approach Towards Homogeneous Flow Rate Optimization


    Beteiligte:
    Li, Xiaocan (Autor:in) / Mercurius, Ray Coden (Autor:in) / Taitler, Ayal (Autor:in) / Wang, Xiaoyu (Autor:in) / Noaeen, Mohammad (Autor:in) / Sanner, Scott (Autor:in) / Abdulhai, Baher (Autor:in)


    Erscheinungsdatum :

    2023-09-24


    Format / Umfang :

    1702994 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Improving Deep Reinforcement Learning-Based Perimeter Metering Control Methods With Domain Control Knowledge

    Zhou, Dongqin / Gayah, Vikash V. | Transportation Research Record | 2023

    Freier Zugriff



    Expandable roof panel perimeter reinforcement

    DONABEDIAN EDGAR EDWARD / WAGNER DARRIN NEIL / KELLER MARK et al. | Europäisches Patentamt | 2015

    Freier Zugriff