Work zone areas are frequent congested sections considered as the freeway bottleneck. Connected and autonomous vehicle (CAV) trajectory optimization can improve the operating efficiency in bottleneck areas by harmonizing vehicles’ manipulations. This study presents a joint trajectory optimization of cooperative lane changing, merging, and car-following actions for CAV control at a local merging point together with upstream points. The multiagent reinforcement learning (MARL) method is applied in this system, with one agent providing a merging advisory service at the merging point and controlling the inner-lane vehicles’ headway for smooth outer-lane vehicle merging, while other agents provide lane-changing advisory services at advance lane-changing points to control how vehicles make lane changes in advance and perform corresponding headway adjustment, similar to and jointly with the merging advisory service. Uniting all agents, the coordination graph (CG) method is applied to seek the global optimum, overcoming the exponential growth problem in MARL. Using MATLAB and the VISSIM COM interface, an online simulation platform is established. The simulation results show that MARL is effective for online computation with in-timing response. More importantly, comparisons of the results obtained in various scenarios demonstrate that the proposed system obtained smoother vehicle trajectories in all controlled sections, rather than only in the merging area, indicating that it can achieve better traffic conditions in freeway work zone areas.


    Access

    Download


    Export, share and cite



    Title :

    Trajectory Optimization of CAVs in Freeway Work Zone considering Car-Following Behaviors Using Online Multiagent Reinforcement Learning


    Contributors:
    Tong Zhu (author) / Xiaohu Li (author) / Wei Fan (author) / Changshuai Wang (author) / Haoxue Liu (author) / Runqing Zhao (author)


    Publication date :

    2021




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown





    Simulated CAVs Driving and Characteristics of the Mixed Traffic Using Reinforcement Learning Method

    Guo, Jingqiu / Liu, Yangzexi / Fang, Shouen | Springer Verlag | 2019



    An adaptive framework for real-time freeway traffic estimation in the presence of CAVs

    Makridis, Michail A. / Kouvelas, Anastasios | Elsevier | 2023


    CAVS 2019 Panel

    IEEE | 2019