his research focuses on the adaptive navigation of maritime autonomous surface ships (MASSs) in an uncertain environment. To achieve intelligent obstacle avoidance of MASSs in a port, an autonomous navigation decision-making model based on hierarchical deep reinforcement learning is proposed. The model is mainly composed of two layers: the scene division layer and an autonomous navigation decision-making layer. The scene division layer mainly quantifies the sub-scenarios according to the International Regulations for Preventing Collisions at Sea (COLREG). This research divides the navigational situation of a ship into entities and attributes based on the ontology model and Protégé language. In the decision-making layer, we designed a deep Q-learning algorithm utilizing the environmental model, ship motion space, reward function, and search strategy to learn the environmental state in a quantized sub-scenario to train the navigation strategy. Finally, two sets of verification experiments of the deep reinforcement learning (DRL) and improved DRL algorithms were designed with Rizhao port as a study case. Moreover, the experimental data were analyzed in terms of the convergence trend, iterative path, and collision avoidance effect. The results indicate that the improved DRL algorithm could effectively improve the navigation safety and collision avoidance.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Decision-Making for the Autonomous Navigation of Maritime Autonomous Surface Ships Based on Scene Division and Deep Reinforcement Learning


    Beteiligte:
    Zhang, X (Autor:in) / Wang, C (Autor:in) / Liu, Y (Autor:in) / Chen, X (Autor:in)

    Erscheinungsdatum :

    19.09.2019


    Anmerkungen:

    Sensors , 19 (18) , Article 4055. (2019)


    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Klassifikation :

    DDC:    629



    Maritime Autonomous Surface Ships

    GWLB - Gottfried Wilhelm Leibniz Bibliothek | 2024

    Freier Zugriff

    Maritime Autonomous Surface Ships

    TIBKAT | 2024

    Freier Zugriff


    Survey on Collision-Avoidance Navigation of Maritime Autonomous Surface Ships

    Wang, Chengbo / Wang, Ning / Xie, Guangming et al. | Springer Verlag | 2021


    Operations of Maritime Autonomous Surface Ships

    Zbigniew Pietrzykowski / Jerzy Hajduk | DOAJ | 2019

    Freier Zugriff