Autonomous vehicles (AVs) have the potential to revolutionize transportation, but their effective integration into the real world requires addressing the challenge of interacting with human drivers. Real-world driving involves negotiating and cooperating with fellow drivers through social cues, necessitating AVs to also demonstrate such social compatibilities. However, despite the popularity, current learning-based control methods for AV policy synthesis often overlook this crucial aspect. In this work, we look at the problem of enabling socially compatible driving when AV control policies are learned. We leverage human driving data to learn a social preference model of human driving and then integrate it with reinforcement learning-based AV policy synthesis using Social Value Orientation theory. In particular, we propose to use multi-task reinforcement learning to learn diverse social compatibility levels in driving (ex: altruistic, prosocial, individualistic, and competitive), focusing on the requirement of having diverse behaviors in real-world driving. Using highway driving scenarios, we demonstrate through experiments that socially compatible AV driving not only enables naturalistic driving behaviors but also reduces collision rates from the baseline. Our findings reveal that without social compatibility, AV policies tend to adopt dangerously competitive driving behaviors, while the incorporation of social compatibility fosters smoother vehicle maneuvers.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-behavior Learning for Socially Compatible Autonomous Driving


    Contributors:


    Publication date :

    2023-09-24


    Size :

    619336 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Socially-Compatible Behavior Design of Autonomous Vehicles with Verification on Real Human Data

    Wang, Letian / Sun, Liting / Tomizuka, Masayoshi et al. | ArXiv | 2020

    Free access

    CLAP: CLOUD-AND-LEARNING-COMPATIBLE AUTONOMOUS DRIVING PLATFORM

    Zhong, Yuanxin / Cao, Zhong / Zhu, Minghan et al. | British Library Conference Proceedings | 2020


    CLAP: Cloud-and-Learning-compatible Autonomous driving Platform

    Zhong, Yuanxin / Cao, Zhong / Zhu, Minghan et al. | IEEE | 2020



    Socially-Aware Autonomous Driving: Inferring Yielding Intentions for Safer Interactions

    Wang, Jing / Jin, Yan / Taghavifar, Hamid et al. | ArXiv | 2025

    Free access