Due to the sparse rewards and high degree of environmental variation, reinforcement learning approaches, such as deep deterministic policy gradient (DDPG), are plagued by issues of high variance when applied in complex real-world environments. We present a new framework for overcoming these issues by incorporating a stochastic switch, allowing an agent to choose between high- and low-variance policies. The stochastic switch can be jointly trained with the original DDPG in the same framework. In this article, we demonstrate the power of the framework in a navigation task, where the robot can dynamically choose to learn through exploration or to use the output of a heuristic controller as guidance. Instead of starting from completely random actions, the navigation capability of a robot can be quickly bootstrapped by several simple independent controllers. The experimental results show that with the aid of stochastic guidance, we are able to effectively and efficiently train DDPG navigation policies and achieve significantly better performance than state-of-the-art baseline models.


    Access

    Download


    Export, share and cite



    Title :

    Learning with stochastic guidance for robot navigation


    Contributors:
    Xie, L (author) / Miao, Y (author) / Sen, W (author) / Blunsom, P (author) / Wang, Z (author) / Cheng, C (author) / Markham, A (author) / Trigoni, N (author)

    Publication date :

    2020-03-02



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    NAVIGATION GUIDANCE

    KAPOOR MEENAL / SASTRI VINAYAK / NAGAR SEEMA et al. | European Patent Office | 2022

    Free access

    Adaptive guidance and integrated navigation with reinforcement meta-learning

    Gaudet, Brian / Linares, Richard / Furfaro, Roberto | Elsevier | 2020



    NAVIGATION LANE GUIDANCE

    WOOLLEY SETH ALAN | European Patent Office | 2019

    Free access