The richness of information generated by today's vehicles fosters the development of data-driven decision-making models, with the additional capability to account for the context in which vehicles operate. In this work, we focus on Adaptive Cruise Control (ACC) in the case of such challenging vehicle maneuvers as cut-in and cut-out, and leverages Deep Reinforcement Learning (DRL) and vehicle connectivity to develop a data-driven cooperative ACC application. Our DRL framework accounts for all the relevant factors, namely, passengers' safety and comfort as well as efficient road capacity usage, and it properly weights them through a two-layer learning approach. We evaluate and compare the performance of the proposed scheme against existing alternatives through the CoMoVe framework, which realistically represents vehicle dynamics, communication and traffic. The results, obtained in different real-world scenarios, show that our solution provides excellent vehicle stability, passengers' comfort, and traffic efficiency, and highlight the crucial role that vehicle connectivity can play in ACC. Notably, our DRL scheme improves the road usage efficiency by being inside the desired range of headway in cut-out and cut-in scenarios for 69% and 78% (resp.) of the time, whereas alternatives respect the desired range only for 15% and 45% (resp.) of the time. We also validate the proposed solution through a hardware-in-the-loop implementation, and demonstrate that it achieves similar performance to that obtained through the CoMoVe framework.


    Access

    Download


    Export, share and cite



    Title :

    An ML-Aided Reinforcement Learning Approach for Challenging Vehicle Maneuvers



    Published in:

    Publication date :

    2023-02-01


    Size :

    2517657 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    An ML-aided Reinforcement Learning Approach for Challenging Vehicle Maneuvers

    Selvaraj, Dinesh Cyril / Hegde, Shailesh / Amati, Nicola et al. | BASE | 2023

    Free access

    A Reinforcement Learning Based Approach for Automated Lane Change Maneuvers

    Wang, Pin / Chan, Ching-Yao / Fortelle, Arnaud de La | IEEE | 2018