Imitation learning on real-world data has the potential to improve the simulation of real-world traffic. However, learning from human demonstrations can be challenging since the recorded behavior is typically noisy and multimodal. Most policies used in such setups parameterize a Gaussian distribution which is then used for sampling actions. This limits the expressiveness of the outputs and more sophisticated policies based on normalizing flows could enable to model more complex and multimodal behavior. We show how to combine the recently proposed Discriminator Actor Critic algorithm with conditional normalizing flow policies and test this setup on real-world driving data. The results show that normalizing flow policies are able to model complex behavior and lead to superior policies. To demonstrate the general applicability of our proposed approach, we also tested them on imitation learning for typical continuous control benchmarks. While the expert demonstrations of these benchmarks are not based on noisy and multimodal realworld behavior, our approach still leads to competitive results compared to state-of-the-art approaches.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Learning Normalizing Flow Policies Based on Highway Demonstrations




    Publication date :

    2021-09-19


    Size :

    570309 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Learning Stable Normalizing-Flow Control for Robotic Manipulation

    Abdul Khader, Shahbaz / Yin, Hang / Pietro, Falco et al. | BASE

    Free access


    High-speed highway scene prediction based on driver models learned from demonstrations

    Gonzalez, David Sierra / Dibangoye, Jilles Steeve / Laugier, Christian | IEEE | 2016


    Multi-Reward Architecture based Reinforcement Learning for Highway Driving Policies

    Yuan, Wei / Yang, Ming / He, Yuesheng et al. | IEEE | 2019