This paper proposes a design scheme of reward function that constantly evaluates both driving states and actions for applying reinforcement learning to automated driving. In the field of reinforcement learning, reward functions often evaluate whether the goal is achieved by assigning values such as +1 for success and -1 for failure. This type of reward function can potentially obtain a policy that achieves the goal, but the process by which the goal is reached is not evaluated. However, process to reach a destination is important for automated driving, such as keeping velocity, avoiding risk, retaining distance from other cars, keeping comfortable for passengers. Therefore, the reward function designed by the proposed scheme is suited for automated driving by evaluating driving process. The effects of the proposed scheme are demonstrated on simulated circuit driving and highway cruising. Asynchronous Advantage Actor-Critic is used, and models are trained under some situations for generalization. The result shows that appropriate driving positions are obtained, such as traveling on the inside of corners, and rapid deceleration to turn along sharp curves. In highway cruising, the ego vehicle becomes able to change lane in an environment where there are other vehicles with suitable deceleration to avoid catching up to a front vehicle, and acceleration so that a rear vehicle does not catch up to the ego vehicle.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Design of Reward Function on Reinforcement Learning for Automated Driving


    Beteiligte:
    Goto, Takeru (Autor:in) / Kizumi, Yuki (Autor:in) / Iwasaki, Shun (Autor:in)

    Erscheinungsdatum :

    2025


    Anmerkungen:

    Accepted in IFAC World Congress 2023, 6 pages, 9 figures
    IFAC-PapersOnLine, Volume 56, Issue 2, 2023, Pages 7948-7953



    Medientyp :

    Preprint


    Format :

    Elektronische Ressource


    Sprache :

    Englisch





    Reward Function Design via Human Knowledge Graph and Inverse Reinforcement Learning for Intelligent Driving

    Guo, Rong / Hong, Ze / Xue, Xiang | British Library Conference Proceedings | 2021


    ROAD: Responsibility-Oriented Reward Design for Reinforcement Learning in Autonomous Driving

    Chen, Yongming / Chen, Miner / Liao, Liewen et al. | ArXiv | 2025

    Freier Zugriff

    Reward Function Design for Stand-Off Tracking of Reinforcement Learning

    Jung, Yeontaek / Kim, Jinrae / Kim, Seong-Hun et al. | TIBKAT | 2023


    Reward Function Design for Stand-Off Tracking of Reinforcement Learning

    Jung, Yeontaek / Kim, Jinrae / Kim, Seong-hun et al. | AIAA | 2023