Recently, there has been growing interest in autonomous shipping due to its potential to improve maritime efficiency and safety. The use of advanced technologies, such as artificial intelligence, can address the current navigational and operational challenges in autonomous shipping. In particular, inland waterway transport (IWT) presents a unique set of challenges, such as crowded waterways and variable environmental conditions. In such dynamic settings, the reliability and robustness of autonomous shipping solutions are critical factors for ensuring safe operations. This paper examines the robustness of benchmark deep reinforcement learning (RL) algorithms, implemented for IWT within an autonomous shipping simulator, and their ability to generate effective motion planning policies. We demonstrate that a model-free approach can achieve an adequate policy in the simulator, successfully navigating port environments never encountered during training. We focus particularly on Soft-Actor Critic (SAC), which we show to be inherently more robust to environmental disturbances compared to MuZero, a state-of-the-art model-based RL algorithm. In this paper, we take a significant step towards developing robust, applied RL frameworks that can be generalized to various vessel types and navigate complex port- and inland environments and scenarios.


    Access

    Download


    Export, share and cite



    Title :

    Evaluating Robustness of Reinforcement Learning Algorithms for Autonomous Shipping


    Contributors:

    Publication date :

    2024


    Remarks:

    5 pages, 4 figures. Will be presented at IEEE RAAI 2024


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Evaluating Robustness of Reinforcement Learning Algorithms for Autonomous Shipping

    Lesy, Bavo / Anwar, Ali / Mercelis, Siegfried | IEEE | 2024


    Robustness of reinforcement learning based autonomous driving technologies

    Hart, Fabian / Technische Universität Dresden | SLUB | 2024


    Robustness of reinforcement learning based autonomous driving technologies

    Hart, Fabian / Technische Universität Dresden | SLUB | 2024


    Robustness of reinforcement learning based autonomous driving technologies

    Hart, Fabian / Technische Universität Dresden | TIBKAT | 2024

    Free access

    IMPROVED ROBUSTNESS AND SAFETY FOR AUTONOMOUS VEHICLE CONTROL WITH ADVERSARIAL REINFORCEMENT LEARNING

    Ma, Xiaobai / Driggs-Campbell, Katherine / Kochenderfer, Mykel J. | British Library Conference Proceedings | 2018