The study aims to evaluate the performance of the transfer learning algorithm to enhance the transferability of a deep reinforcement learning-based variable speed limits (VSL) control. The Double Deep Q Network (DDQN)-based VSL control strategy is proposed for reducing total time spent (TTS) on freeways. A real merging bottleneck is developed in the simulation and considered for the VSL control as the source scenario. Three types of target scenarios are considered, including the overspeed scenarios, adverse weather scenarios, and diverse capacity drop scenarios. A stable testing demand and a fluctuating testing demand are adopted to evaluate the effects of VSL control. The results show that by updating the neural networks, the transfer learning in the DDQN-based VSL control agent successfully transfers knowledge learned in the source scenario to other target scenarios. With the transfer learning, the entire training process is shortened by 32.3% to 69.8%, while keeping a similar maximum reward level, as compared to the VSL control with full learning from scratch. With the transferred DDQN-based VSL strategy, the TTS is reduced by 26.02% to 67.37% with the stable testing demand and 21.31% to 69.98% with the fluctuating testing demand in various scenarios, respectively. The results also show that when the task similarity between the source scenario and target scenario is relatively low, the transfer learning could lead to local optimum and may not achieve the global optimal control effects.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Enhancing Transferability of Deep Reinforcement Learning-Based Variable Speed Limit Control Using Transfer Learning


    Beteiligte:
    Ke, Zemian (Autor:in) / Li, Zhibin (Autor:in) / Cao, Zehong (Autor:in) / Liu, Pan (Autor:in)


    Erscheinungsdatum :

    01.07.2021


    Format / Umfang :

    2379511 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Extended Variable Speed Limit control using Multi-agent Reinforcement Learning

    Kusic, Kresimir / Dusparic, Ivana / Gueriau, Maxime et al. | IEEE | 2020



    Highway differential variable speed limit control method and device based on deep reinforcement learning and storage medium

    ZHANG ZHAOLEI / MIAO WENJIE / HAO WEI et al. | Europäisches Patentamt | 2024

    Freier Zugriff

    Dynamic Variable Speed Limit Zones Allocation Using Distributed Multi-Agent Reinforcement Learning

    Kusic, Kresimir / Ivanjko, Edouard / Vrbanic, Filip et al. | IEEE | 2021