This article describes the application of Reinforcement Learning (RL) with an embedded heuristic algorithm to a multi-objective hybrid vehicle optimization. A multi-objective optimization problem (MOP) is defined as a minimization of total energy consumption and trip time resulting from optimal control of vehicle speed over a known route. First, a computationally efficient heuristic optimization algorithm is formulated to solve the MOP for multiple traffic scenarios. Then, the off-line integration of RL is applied to the heuristic optimization algorithm process and utilized to solve the MOP. Finally, the online optimization capability of the machine learning algorithm is discussed, as well as its extension to the vehicle routing problem and the hybrid electric vehicle. The specific scenario investigated is where a generic vehicle begins a trip on a one-lane highway. The length of the highway and the number of vehicles and traffic signals on the road are generic as well. The vehicle must decide on the optimal sequence of speed (or acceleration/deceleration level) for each time step to minimize both the total energy consumption and trip time until it reaches the end of the route. The agent is assumed to be capable of sensing and estimating the relative speed and distance to other vehicles using advanced driver assistance systems (ADAS) sensors or through vehicle-to-vehicle (V2V) communications. Vehicle-to-infrastructure (V2I) communication is assumed for all vehicles so that location of traffic signals and their signal times are known in advance. The constraints in the optimization include speed limits, no traffic signal violation, and no collision with other vehicles. For the three traffic scenarios, the achieved energy savings by the heuristic algorithm is between 11% and 17% compared to the average consumption in kilowatt-hour (kWh) of the design of experiments (DOE) type of traffic simulation.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Reinforcement Learning Algorithm for Speed Optimization and Optimal Energy Management of Advanced Driver Assistance Systems and Connected Vehicles


    Weitere Titelangaben:

    Sae Int. J. Commer. Veh


    Beteiligte:
    Mollo, Christopher (Autor:in) / Shim, Yohan (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2021-08-25


    Format / Umfang :

    14 pages




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Autonomous Vehicles and Advanced Driver Assistance

    KRISHNAN ASHOK | Europäisches Patentamt | 2024

    Freier Zugriff

    Lane Change Driver Assistance System for Online Operation Optimization of Connected Vehicles

    Aubeck, Franz / Oetermann, Tobias / Birmes, Georg et al. | IEEE | 2019


    LiDAR-Based Advanced Driver Assistance for Vehicles

    Y, Harshalatha / V, Nagesh M / Hebbar, Navya G et al. | IEEE | 2023


    Application of Advanced Driver-Assistance Systems in Police Vehicles

    Nasr, Vanessa / Wozniak, David / Shahini, Farzaneh et al. | Transportation Research Record | 2021


    Advanced Road Vehicles: Control Technologies, Driver Assistance

    Ammon, Dieter / Schiehlen, Werner | Springer Verlag | 2009