Kinodynamic motion planning is critical for autonomous vehicles with high maneuverability in dynamic environments. However, obtaining near-optimal motion planning solutions with low computational costs and inaccurate prior model information is challenging. To address this issue, this paper proposes a receding-horizon reinforcement learning approach for kinodynamic motion planning (RHRL-KDP) of autonomous vehicles in the presence of inaccurate dynamics information and moving obstacles. Specifically, a receding-horizon actor-critic reinforcement learning algorithm is presented, resulting in a neural network-based planning strategy that can be learned both offline and online. A neural network-based model is built and learned online to approximate the modeling uncertainty of the prior nominal model in order to improve planning performance. Furthermore, active collision avoidance in dynamic environments is realized by constructing safety-related terms in actor and critic networks using potential fields. In theory, the uniformly ultimate boundedness property of the modeling uncertainty’s approximation error is proven, and the convergence of the proposed RHRL-KDP is analyzed. Simulation tests show that our approach outperforms the previously developed motion planners based on model predictive control (MPC), safe RL, and RRT${^\star }$ in terms of planning performance. Furthermore, in both online and offline learning scenarios, RHRL-KDP outperforms MPC and RRT$^{\star }$ in terms of computational efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Receding-Horizon Reinforcement Learning Approach for Kinodynamic Motion Planning of Autonomous Vehicles


    Contributors:
    Zhang, Xinglong (author) / Jiang, Yan (author) / Lu, Yang (author) / Xu, Xin (author)

    Published in:

    Publication date :

    2022-09-01


    Size :

    3531456 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Exact Reactive Receding Horizon Motion Planning for Aerial Vehicles

    Yadav, Indrajeet / Tanner, Herbert G. | IEEE | 2021


    Kinodynamic Motion Planning for Autonomous Surface Ships Using Motion Primitives

    Qin, Xiangxiang / Liu, Jialun / Liu, Zhengguo et al. | IEEE | 2021


    Kinodynamic motion planning amidst moving obstacles

    Kindel, R. / Hsu, D. / Latombe, J.C. et al. | Tema Archive | 2000


    Kinodynamic Motion Planning Using Multi-Objective optimization

    Hart, Patrick / Knoll, Alois | IEEE | 2018


    Prognostics-enhanced Receding Horizon Mission Planning for Field Unmanned Vehicles

    Zhang, Bin / Tang, Liang / DeCastro, Jonathan et al. | AIAA | 2011