The control of connected autonomous vehicles (CAVs) for cooperative sensing and driving in mixed traffic flows is critical for the development of intelligent transportation systems. However, the challenge lies in effectively representing and learning from the interactions between heterogeneous traffic agents, as well as the complex traffic states they produce. To address this, we propose the Multi-View Graph Convolution Network Reinforcement Learning (MVGRL) algorithm for the decision-making and control of CAVs in mixed traffic scenarios. First, multi-view graphs are constructed based on multiple logical correlations and the perception-communication relationship of heterogeneous vehicles in mixed traffic. This enables us to represent the dynamic vehicle networks and gain insights into vehicle behavior. Then, the features of multi-view vehicle network graphs are derived by multi-view graph convolutional network reinforcement learning. Finally, the lane change decisions of CAVs are obtained based on complex traffic state learning. In the highway scenario, the model is able to control the CAVs to complete the ramp exit task and maintain an overall efficient traffic flow. Various test scenarios were formed by adjusting the traffic conditions under a highway off-ramp scenario for comparison experiments. The results show that the proposed MVGRL algorithm model outperforms in decision-making and robustness than the baseline models.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-View Graph Convolution Network Reinforcement Learning for CAVs Cooperative Control in Highway Mixed Traffic


    Contributors:
    Xu, Dongwei (author) / Liu, Peiwen (author) / Li, Haijian (author) / Guo, Haifeng (author) / Xie, Zijia (author) / Xuan, Qi (author)

    Published in:

    Publication date :

    2024-01-01


    Size :

    2194920 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Simulated CAVs Driving and Characteristics of the Mixed Traffic Using Reinforcement Learning Method

    Guo, Jingqiu / Liu, Yangzexi / Fang, Shouen | Springer Verlag | 2019


    Cooperative Incident Management in Mixed Traffic of CAVs and Human-Driven Vehicles

    Yue, Wenwei / Li, Changle / Wang, Shangbo et al. | IEEE | 2023


    Deep Double Q-Learning Method for CAVs Traffic Signal Control

    Zhao, Chunxia / Lin, Peiqun / Liu, QingChao et al. | SAE Technical Papers | 2020



    Deep Double Q-Learning Method for CAVs Traffic Signal Control

    Su, Ziyi / Liu, QingChao / Zhao, Chunxia et al. | British Library Conference Proceedings | 2020