Fuel efficiency in platooning systems is a central topic of interest because of its significant economic and environmental impact on the transportation industry. In platoon systems, Adaptive Cruise Control (ACC) is widely adopted because it can guarantee string stability while requiring only radar or lidar measurements. A key parameter in ACC is the desired time gap between the platoon's neighboring vehicles. A small time gap results in a short inter-vehicular distance, which is fuel efficient when the vehicles are moving at constant speeds due to air drag reductions. On the other hand, when the vehicles accelerate and brake a lot, a bigger time gap is more fuel efficient. This motivates us to find a policy that minimizes fuel consumption by conveniently switching between two desired time gap parameters. Thus, one can interpret this formulation as a dynamic system controlled by a switching ACC, and the learning problem reduces to finding a switching rule that is fuel efficient. We apply a Reinforcement Learning (RL) algorithm to find a time switching policy between two desired time gap parameters of an ACC controller to reach our goal. We adopt the proximal policy optimization (PPO) algorithm to learn the appropriate transient shift times that minimize the platoon's fuel consumption when it faces stochastic traffic conditions. Numerical simulations show that the PPO algorithm outperforms both static time gap ACC and a threshold-based switching control in terms of the average fuel efficiency.


    Access

    Download


    Export, share and cite



    Title :

    Reducing fuel consumption in platooning systems through reinforcement learning



    Publication date :

    2022-07-01


    Remarks:

    Cunha , R F , Gongalves , T R , Varma , V S , Elayoubi , S E & Cao , M 2022 , Reducing fuel consumption in platooning systems through reinforcement learning . in J Kocijan & K Guelton (eds) , 6th IFAC Conference on Intelligent Control and Automation Sciences ICONS 2022 . IFAC-PapersOnLine , no. 15 , vol. 55 , Elsevier , pp. 99-104 , 6th IFAC Conference on Intelligent Control and Automation Sciences, ICONS 2022 , Cluj-Napoca , Romania , 13/07/2022 . https://doi.org/10.1016/j.ifacol.2022.07.615



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Fuel-Efficient Switching Control for Platooning Systems With Deep Reinforcement Learning

    Goncalves, Tiago Rocha / Cunha, Rafael Fernandes / Varma, Vineeth Satheeskumar et al. | IEEE | 2023



    Vehicle Platooning: An Energy Consumption Perspective

    Bichiou, Youssef / Rakha, Hesham | IEEE | 2020