Imitation learning (IL) enables robots to acquire skills quickly by transferring expert knowledge, which is widely adopted in reinforcement learning (RL) to initialize exploration. However, in long-horizon motion planning tasks, a challenging problem in deploying IL and RL methods is how to generate and collect massive, broadly distributed data such that these methods can generalize effectively. In this work, we solve this problem using our proposed approach called {self-imitation learning by planning (SILP)}, where demonstration data are collected automatically by planning on the visited states from the current policy. SILP is inspired by the observation that successfully visited states in the early reinforcement learning stage are collision-free nodes in the graph-search based motion planner, so we can plan and relabel robot's own trials as demonstrations for policy learning. Due to these self-generated demonstrations, we relieve the human operator from the laborious data preparation process required by IL and RL methods in solving complex motion planning tasks. The evaluation results show that our SILP method achieves higher success rates and enhances sample efficiency compared to selected baselines, and the policy learned in simulation performs well in a real-world placement task with changing goals and obstacles.


    Access

    Download


    Export, share and cite



    Title :

    Self-Imitation Learning by Planning


    Contributors:

    Publication date :

    2021-10-18


    Remarks:

    Luo , S , Kasaei , H & Schomaker , L 2021 , Self-Imitation Learning by Planning . in 2021 IEEE International Conference on Robotics and Automation (ICRA) . IEEE , pp. 4823-4829 , The 2021 International Conference on Robotics and Automation , Xi’an , China , 30/05/2021 . https://doi.org/10.1109/ICRA48506.2021.9561411



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Keywords :

    Classification :

    DDC:    629



    Imitation Learning for Trajectory Planning

    WRAY KYLE HOLLINS / OSTAFEW CHRISTOPHER | European Patent Office | 2024

    Free access


    Vision-Based Trajectory Planning via Imitation Learning for Autonomous Vehicles

    Cai, Peide / Sun, Yuxiang / Chen, Yuying et al. | IEEE | 2019