Autonomous vehicles trained through Multi-Agent Reinforcement Learning (MARL) have shown impressive results in many driving scenarios. However, the performance of these trained policies can be impacted when faced with diverse driving styles and personalities, particularly in highly interactive situations. This is because conventional MARL algorithms usually operate under the assumption of fully cooperative behavior among all agents and focus on maximizing team rewards during training. To address this issue, we introduce the Personality Modeling Network (PeMN), which includes a cooperation value function and personality parameters to model the varied interactions in high-interactive scenarios. The PeMN also enables the training of a background traffic flow with diverse behaviors, thereby improving the performance and generalization of the ego vehicle. Our extensive experimental studies, which incorporate different personality parameters in high-interactive driving scenarios, demonstrate that the personality parameters effectively model diverse driving styles and that policies trained with PeMN demonstrate better generalization compared to traditional MARL methods.


    Access

    Download


    Export, share and cite



    Title :

    Learning to Model Diverse Driving Behaviors in Highly Interactive Autonomous Driving Scenarios with Multi-Agent Reinforcement Learning


    Contributors:
    Weiwei, Liu (author) / Wenxuan, Hu (author) / Wei, Jing (author) / Lanxin, Lei (author) / Lingping, Gao (author) / Yong, Liu (author)

    Publication date :

    2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Deep Hierarchical Reinforcement Learning for Autonomous Driving with Distinct Behaviors

    Chen, Jianyu / Wang, Zining / Tomizuka, Masayoshi | IEEE | 2018


    DEEP HIERARCHICAL REINFORCEMENT LEARNING FOR AUTONOMOUS DRIVING WITH DISTINCT BEHAVIORS

    Chen, Jianyu / Wang, Zining / Tomizuka, Masayoshi | British Library Conference Proceedings | 2018


    Mastering Cooperative Driving Strategy in Complex Scenarios using Multi-Agent Reinforcement Learning

    Liang, Qingyi / Jiang, Zhengmin / Yin, Jianwen et al. | IEEE | 2023


    A Reinforcement Learning Benchmark for Autonomous Driving in General Urban Scenarios

    Jiang, Yuxuan / Zhan, Guojian / Lan, Zhiqian et al. | IEEE | 2024


    Efficient-Enhanced Reinforcement Learning for Autonomous Driving in Urban Traffic Scenarios

    Yin, Jianwen / Jiang, Zhengmin / Liang, Qingyi et al. | IEEE | 2023