The push toward sustainable transportation emphasizes vehicular energy efficiency in mixed traffic scenarios. A research hotspot is the cooperative control of connected and automated vehicles (CAVs), particularly in contexts involving the uncertainties of human-driven vehicles (HDVs). Cooperative control strategies are pivotal in improving driving safety, traffic efficiency, and reducing energy consumption. Our study introduces a cooperative control strategy for CAVs in mixed traffic based on the multiagent twin delayed deep deterministic policy gradient (MATD3) algorithm. We use the intelligent driver model (IDM) to calibrate and model human driving behaviors with 1737 car-following events from the Next Generation Simulation (NGSIM) dataset for their high frequency in real-world driving. The reward function of MATD3 integrates safety, traffic efficiency, passenger comfort, and energy efficiency. An action mask scheme is incorporated to prevent collisions, thereby boosting learning efficiency. Monte Carlo simulation results show that our strategy outperforms IDM and model predictive control (MPC) in improving energy efficiency by an average of 7.73% and 3.38%, respectively. Furthermore, our framework offers extended benefits to HDVs, which achieve improved energy efficiency following the CAVs’ control pattern. A case study further demonstrates that a “moderate” driving style results in lower energy consumption, effectively linking human behaviors to energy efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multiagent Reinforcement Learning for Ecological Car-Following Control in Mixed Traffic


    Contributors:
    Wang, Qun (author) / Ju, Fei (author) / Wang, Huaiyu (author) / Qian, Yahui (author) / Zhu, Meixin (author) / Zhuang, Weichao (author) / Wang, Liangmo (author)


    Publication date :

    2024-12-01


    Size :

    11510316 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Multimodal adaptive traffic signal control: A decentralized multiagent reinforcement learning approach

    Kareem Othman / Xiaoyu Wang / Amer Shalaby et al. | DOAJ | 2025

    Free access

    Multiagent Reinforcement Learning for Traffic Signal Control: a k-Nearest Neighbors Based Approach

    Almeida, Vicente Nejar de / Bazzan, Ana L. C. / Abdoos, Monireh | TIBKAT | 2022

    Free access


    Autonomous Bus Fleet Control Using Multiagent Reinforcement Learning

    Sung-Jung Wang / S. K. Jason Chang | DOAJ | 2021

    Free access

    Multiagent reinforcement learning for autonomous driving in traffic zones with unsignalized intersections

    Spatharis, Christos / Blekas, Konstantinos | Taylor & Francis Verlag | 2024