In this paper, we propose a joint behavior and motion planning agent based on DRL (Deep Reinforcement Learning) intended for automated vehicles in a crowded merging scenario. The agent is trained using the PPO (Proximal Policy Optimization) algorithm, a state-of-the-art solution that ensures training stability and sample efficiency. We include temporal information in the observation of our agent to improve system stability. We have defined a simulated environment using the CARLA (Car Learning to Act) simulator, which handles the behavior of all other vehicles in the simulated world, in which the agent performs the merging maneuver. We perform a comparison between our temporal approach and an established, distance-based one, both in terms of safety, smoothness and comfort. We further analyze specific examples of both systems to describe the performance differences between them. Results show that our proposed agent yields a smoother, safer experience, and prove the viability of interweaving both systems within the same agent.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Temporal Based Deep Reinforcement Learning for Crowded Lane Merging Maneuvers




    Publication date :

    2023-09-24


    Size :

    2867442 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Lane Changing and Merging Maneuvers of Carlike Robots

    Bibhya Sharma / Jito Vanualailai / Ravindra Rai | BASE | 2012

    Free access

    A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers

    Wang, Pin / Chan, Ching-Yao / Fortelle, Arnaud de La | IEEE | 2018


    A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers

    Wang, Pin / Chan, Ching-Yao / de La Fortelle, Arnaud | ArXiv | 2018

    Free access

    A REINFORCEMENT LEARNING BASED APPROACH FOR AUTOMATED LANE CHANGE MANEUVERS

    Wang, Pin / Chan, Ching-Yao / de La Fortelle, Arnaud | British Library Conference Proceedings | 2018


    Lane-Merging Using Policy-based Reinforcement Learning and Post-Optimization

    Hart, Patrick / Rychly, Leonard / Knoll, Alois | IEEE | 2019