Despite significant progress in autonomous vehicles (AVs), the development of driving policies that ensure both the safety of AVs and traffic flow efficiency has not yet been fully explored. In this paper, we propose an enhanced human-in-the-loop reinforcement learning method, termed the Human as AI mentor-based deep reinforcement learning (HAIM-DRL) framework, which facilitates safe and efficient autonomous driving in mixed traffic platoon. Drawing inspiration from the human learning process, we first introduce an innovative learning paradigm that effectively injects human intelligence into AI, termed Human as AI mentor (HAIM). In this paradigm, the human expert serves as a mentor to the AI agent. While allowing the agent to sufficiently explore uncertain environments, the human expert can take control in dangerous situations and demonstrate correct actions to avoid potential accidents. On the other hand, the agent could be guided to minimize traffic flow disturbance, thereby optimizing traffic flow efficiency. In detail, HAIM-DRL leverages data collected from free exploration and partial human demonstrations as its two training sources. Remarkably, we circumvent the intricate process of manually designing reward functions; instead, we directly derive proxy state-action values from partial human demonstrations to guide the agents’ policy learning. Additionally, we employ a minimal intervention technique to reduce the human mentor’s cognitive load. Comparative results show that HAIM-DRL outperforms traditional methods in driving safety, sampling efficiency, mitigation of traffic flow disturbance, and generalizability to unseen traffic scenarios.


    Access

    Download


    Export, share and cite



    Title :

    Human as AI mentor: Enhanced human-in-the-loop reinforcement learning for safe and efficient autonomous driving


    Contributors:
    Zilin Huang (author) / Zihao Sheng (author) / Chengyuan Ma (author) / Sikai Chen (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown





    Efficient-Enhanced Reinforcement Learning for Autonomous Driving in Urban Traffic Scenarios

    Yin, Jianwen / Jiang, Zhengmin / Liang, Qingyi et al. | IEEE | 2023



    Safe and Rule-Aware Deep Reinforcement Learning for Autonomous Driving at Intersections

    Zhang, Chi / Kacem, Kais / Hinz, Gereon et al. | IEEE | 2022


    Human-Like Decision Making and Planning for Autonomous Driving with Reinforcement Learning

    Zong, Ziqi / Shi, Jiamin / Wang, Runsheng et al. | IEEE | 2023