To learn a reward function that a driver adheres to is of importance to the human-like design of autonomous driving systems. Inverse reinforcement learning (IRL) is one of the recent advances that can achieve this objective, but it often suffers from the low efficiency of generating optimal policy by reinforcement learning (RL) each time when updating reward weights. This paper presents an accelerated IRL method by approaching the optimal policy among randomly pre-sampled policies in designed sub-space instead of finding it through RL in the whole policy space. The corresponding trajectories are targeted via an optimal trajectory selector in the candidate trajectory library generated by pre-sampled policies. The weights then are updated by comparing the selected trajectories and the expert ones. The proposed method is very suitable for improving learning efficiency for low-dimensional problems like autonomous driving, whose expert policies are nearly tractable. Results with simulated driving data show that it only took 11 iterations to converge, while the average longitudinal RMS error of the recovered trajectories based on the learned reward function was only 2.14m.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Accelerated Inverse Reinforcement Learning with Randomly Pre-sampled Policies for Autonomous Driving Reward Design


    Beteiligte:
    Xin, Long (Autor:in) / Li, Shengbo Eben (Autor:in) / Wang, Pin (Autor:in) / Cao, Wenhan (Autor:in) / Nie, Bingbing (Autor:in) / Chan, Ching-Yao (Autor:in) / Cheng, Bo (Autor:in)


    Erscheinungsdatum :

    01.10.2019


    Format / Umfang :

    708210 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    ROAD: Responsibility-Oriented Reward Design for Reinforcement Learning in Autonomous Driving

    Chen, Yongming / Chen, Miner / Liao, Liewen et al. | ArXiv | 2025

    Freier Zugriff

    Multi-Reward Architecture based Reinforcement Learning for Highway Driving Policies

    Yuan, Wei / Yang, Ming / He, Yuesheng et al. | IEEE | 2019



    Reward Function Design via Human Knowledge Graph and Inverse Reinforcement Learning for Intelligent Driving

    Guo, Rong / Hong, Ze / Xue, Xiang | British Library Conference Proceedings | 2021