In this paper, a navigation situation adaptive learning-based path planning (NSAL-PP) scheme is created for a maritime autonomous surface ships (MASS) with a hierarchical deep reinforcement learning (HDRL) algorithm. In the first level of hierarchy, the MASS navigational situation is adaptively learnt from the ontology theory and the Protégé logical language in terms of entities and attributes. In the second level of hierarchy, path planning skills are learnt by combining with deep Q-learning, the environment model, ship behavior space, reward function and exploration and utilization strategy. Specifically, the reward function consists of safety and navigational task. Finally, the simulations are built in the Python and 2D-Pygame platform, with Tianjin Port of China as a case study. Both simulation and experimental results demonstrate that the proposed NSAL-PP method is feasible and the collision free navigation is achieved, especially for narrow channel (waterway).


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Navigation Situation Adaptive Learning-Based Path Planning of Maritime Autonomous Surface Ships


    Contributors:
    Wang, Chengbo (author) / Zhang, Xinyu (author) / Wang, Leihao (author)


    Publication date :

    2021-10-22


    Size :

    1361094 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Survey on Collision-Avoidance Navigation of Maritime Autonomous Surface Ships

    Wang, Chengbo / Wang, Ning / Xie, Guangming et al. | Springer Verlag | 2021


    Adaptive federated filter–combined navigation algorithm based on observability sharing factor for maritime autonomous surface ships

    Guo, Muzhuang / Zhou, Xiaomin / Guo, Chen et al. | Taylor & Francis Verlag | 2024

    Free access

    Operations of Maritime Autonomous Surface Ships

    Zbigniew Pietrzykowski / Jerzy Hajduk | DOAJ | 2019

    Free access


    Quantitative Processing of Situation Awareness for Autonomous Ships Navigation

    Xiang Yu Zhou / Zheng Jiang Liu / Zhao Lin Wu et al. | DOAJ | 2019

    Free access