The advent of intelligent Connected Autonomous Vehicles (CAVs), smart traffic control infrastructure, and Vehicle-to-Infrastructure (V2I) communication provide many opportunities to increase energy efficiency while minimizing the waiting time at signalled intersections, even though only some vehicles are CAVs and the others are human-driven. Unlike the traditional approaches using Model Predictive Control (MPC) that rely on manually designing speed control strategies, this paper proposes a reinforcement learning-based method, named Energy Efficiency Intersection Control and CAVs' speed control (E2-ICCAV). More specifically, the method consists of a manager module for the intersection and a worker module for each CAV. The manager module focuses on learning about the phase selections of the intersection to minimize all vehicles' waiting time and energy consumption. To achieve this end, we adopt an options framework for the manager module and empower it to choose reasonable phases and maintain them for a reasonable period. In the worker module, we regard each CAV as a worker and formulate CAVs' speed control problem as a Markov game. Each worker aims to minimize both hard accelerations and braking, while always keeping a safe distance from the leading vehicle. The evaluation results show that the proposed E2-ICCAV method can achieve the shortest waiting time and queue length as well as the fewest hard accelerations and braking. In addition, we have developed an infrastructure-assisted eco-drive automated driving system using a real-world test bed which is a proof-of-concept for large scale intersection control in smart cities.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Reinforcement Learning Approach to CAV and Intersection Control for Energy Efficiency


    Contributors:


    Publication date :

    2022-04-01


    Size :

    1369419 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Hierarchical Reinforcement Learning Approach for the Road Intersection Task

    Shikunov, Maxim / Panov, Aleksandr I. | Springer Verlag | 2019


    Single-intersection intersection traffic light control method based on improved deep reinforcement learning

    LIU BINGYAN / GUO HONG / DU JUNLIN et al. | European Patent Office | 2024

    Free access

    Multi-Intersection Signal Control Based on Asynchronous Reinforcement Learning

    Jixiang Wang / Siqi Chen / Jing Wei et al. | DOAJ | 2025

    Free access

    Urban intersection signal control method based on deep reinforcement learning

    JU YANNI / MA DIE | European Patent Office | 2024

    Free access