Reinforcement Learning (RL) controllers have proved to effectively tackle the dual objectives of path following and collision avoidance. However, finding which RL algorithm setup optimally trades off these two tasks is not necessarily easy. This work proposes a methodology to explore this that leverages analyzing the performance and task-specific behavioral characteristics for a range of RL algorithms applied to path-following and collision-avoidance for underactuated surface vehicles in environments of increasing complexity. Compared to the introduced RL algorithms, the results show that the Proximal Policy Optimization (PPO) algorithm exhibits superior robustness to changes in the environment complexity, the reward function, and when generalized to environments with a considerable domain gap from the training environment. Whereas the proposed reward function significantly improves the competing algorithms ability to solve the training environment, an unexpected consequence of the dimensionality reduction in the sensor suite, combined with the domain gap, is identified as the source of their impaired generalization performance. ; publishedVersion


    Access

    Download


    Export, share and cite



    Title :

    Comparing Deep Reinforcement Learning Algorithms Ability to Safely Navigate Challenging Waters



    Publication date :

    2021-01-01


    Remarks:

    cristin:1931036
    19 ; 8 ; Frontiers in Robotics and AI ; 738113



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Comparing Deep Reinforcement Learning Algorithms’ Ability to Safely Navigate Challenging Waters

    Larsen, Thomas Nakken / Teigen, Halvor Ødegård / Laache, Torkel et al. | BASE | 2021

    Free access


    Evolutionary Acquisition: Learning to Navigate the Spiral

    Tammany, B. / AHS International | British Library Conference Proceedings | 2008


    Evaluation of Deep Reinforcement Learning Algorithms for Autonomous Driving

    Stang, Marco / Grimm, Daniel / Gaiser, Moritz et al. | IEEE | 2020


    How to navigate today

    Hart, Marion Rice | SLUB | 1953