In this paper, we study how to learn a harmonious deep reinforcement learning (DRL) based lane-changing strategy for autonomous vehicles without Vehicle-to-Everything (V2X) communication support. The basic framework of this paper can be viewed as a multi-agent reinforcement learning in which different agents will exchange their strategies after each round of learning to reach a zero-sum game state. Unlike cooperation driving, harmonious driving only relies on individual vehicles’ limited sensing results to balance overall and individual efficiency. Specifically, we propose a well-designed reward that combines individual efficiency with overall efficiency for harmony, instead of only emphasizing individual interests like competitive strategy. Testing results show that competitive strategy often leads to selfish lane change behaviors, anarchy of crowd, and thus the degeneration of traffic efficiency. In contrast, the proposed harmonious strategy can promote traffic efficiency in both free flow and traffic jam than the competitive strategy. This interesting finding indicates that we should take care of the reward setting for reinforcement learning-based AI robots (e.g., automated vehicles) design, when the utilities of these robots are not strictly in alignment.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Harmonious Lane Changing via Deep Reinforcement Learning


    Contributors:
    Wang, Guan (author) / Hu, Jianming (author) / Li, Zhiheng (author) / Li, Li (author)


    Publication date :

    2022-05-01


    Size :

    3742850 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Deep Reinforcement Learning Approach for Automated Vehicle Mandatory Lane Changing

    Ammourah, Rami / Talebpour, Alireza | Transportation Research Record | 2022



    Automatic driving vehicle lane changing method based on double-layer deep reinforcement learning

    PENG JIANKUN / SHEN YANG / ZHANG SIYU et al. | European Patent Office | 2023

    Free access

    Automatic driving vehicle lane changing decision system and method based on deep reinforcement learning

    XIONG MINGQIANG / QIAO JIE / JIANG MENG et al. | European Patent Office | 2022

    Free access

    Bottleneck area lane changing control method and device based on deep reinforcement learning and medium

    DUAN YAOXIN / ZHANG HUI / NIE WENDI et al. | European Patent Office | 2023

    Free access