In this article, the authors present a novel method to learn the personalized tactic of discretionary lane-change initiation for fully autonomous vehicles through human-computer interactions. Instead of learning from human-driving demonstrations, a reinforcement learning technique is employed to learn how to initiate lane changes from traffic context, the action of a self-driving vehicle, and in-vehicle user feedback. The proposed offline algorithm rewards the action-selection strategy when the user gives positive feedback and penalizes it when negative feedback. Also, a multi-dimensional driving scenario is considered to represent a more realistic lane-change trade-off. The results show that the lane-change initiation model obtained by this method can reproduce the personal lane-change tactic, and the performance of the customized models (average accuracy 86.1%) is much better than that of the non-customized models (average accuracy 75.7%). This method allows continuous improvement of customization for users during fully autonomous driving even without human-driving experience, which will significantly enhance the user acceptance of high-level autonomy of self-driving vehicles.


    Access

    Download


    Export, share and cite



    Title :

    Learning Personalized Discretionary Lane-Change Initiation for Fully Autonomous Driving Based on Reinforcement Learning


    Contributors:
    Liu, Zhuoxi (author) / Wang, Zheng (author) / Yang, Bo (author) / Nakano, Kimihiko (author)

    Publication date :

    2020


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    A Machine Learning Approach for Personalized Autonomous Lane Change Initiation and Control

    Vallon, Charlott / Ercan, Ziya / Carvalho, Ashwin et al. | British Library Conference Proceedings | 2017


    Safe Hybrid-Action Reinforcement Learning-Based Decision and Control for Discretionary Lane Change

    Xu, Ruichen / Liu, Xiao / Xu, Jinming et al. | ArXiv | 2024

    Free access

    A machine learning approach for personalized autonomous lane change initiation and control

    Vallon, Charlott / Ercan, Ziya / Carvalho, Ashwin et al. | IEEE | 2017


    A Learning-based Discretionary Lane-Change Decision-Making Model with Driving Style Awareness

    Zhang, Yifan / Xu, Qian / Wang, Jianping et al. | ArXiv | 2020

    Free access