High-quality and representative data is essential for both Imitation Learning (IL)- and Reinforcement Learning (RL)-based motion planning tasks. For real robots, it is challenging to collect enough qualified data either as demonstrations for IL or experiences for RL due to safety consideration in environments with obstacles. We target this challenge by proposing the selfimitation learning by planning plus (SILP+) algorithm, which efficiently embeds experience-based planning into the learning architecture to mitigate the data-collection problem. The planner generates demonstrations based on successfully visited states from the current RL policy, and the policy improves by learning from these demonstrations. In this way, we relieve the demand for human expert operators to collect demonstrations required by IL and improve the RL performance as well. Various experimental results shows that SILP+ achieves better training efficiency, higher and more stable success rate in complex motion planning tasks compared to several other methods. Extensive tests on physical robots illustrate the effectiveness of SILP+ in a physical setting, retaining a success rate of 90% where the next-best contender drops from 87% to 75% in the Sim2Real transition.


    Access

    Download


    Export, share and cite



    Title :

    Reinforcement learning in robotic motion planning by combined experience-based planning and self-imitation learning


    Contributors:

    Publication date :

    2023-12-01


    Remarks:

    Luo , S & Schomaker , L 2023 , ' Reinforcement learning in robotic motion planning by combined experience-based planning and self-imitation learning ' , Robotics and Autonomous Systems , vol. 170 , 104545 . https://doi.org/10.1016/j.robot.2023.104545



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Self-Imitation Learning by Planning

    Luo, Sha / Kasaei, Hamidreza / Schomaker, Lambert | BASE | 2021

    Free access


    Imitation Learning for Trajectory Planning

    WRAY KYLE HOLLINS / OSTAFEW CHRISTOPHER | European Patent Office | 2024

    Free access


    Vision-Based Trajectory Planning via Imitation Learning for Autonomous Vehicles

    Cai, Peide / Sun, Yuxiang / Chen, Yuying et al. | IEEE | 2019