In order to reduce the influence of human factors on ship collision avoidance, this paper proposes an autonomous collision avoidance decision-making algorithm based on Double Deep Q Network (DDQN) with prioritized experience replay (PER). Based on a full understanding of the International Regulations for Preventing Collision at Sea (COLREGs), and the reward function of the autonomous collision avoidance decision-making algorithm is guided and designed in terms of the number of rudder operations, the amount of the cumulative steering angle during the avoidance process, the DCPA when clear of the other ship, the deviation distance at the end of the avoidance, the total magnitude of ship heading changes during the avoidance process and rule compliance by combining with the statistical results of real water traffic data. Ship encounter scenarios are constructed based on COLREGs, which are arranged and combined the sample training and testing sets for the agent; We compare the algorithm proposed in this paper with DQN, DQN with prioritized experience replay and DDQN algorithms by simulating the same encounter scenario, using this as the training set for the model; Finally, multi-ship encounter scenario simulations are set up as the testing set for the model to verify the performance of the algorithm. The results show that compared with three other reinforcement learning algorithms, DDQN with prioritized experience replay algorithm can make ship collision avoidance decision-making more efficient and improve the safety of ship autonomous navigation under COLREGs; and the trained model can be replicated and applied to a system with any number of agents to provide a reference for ship autonomous collision avoidance research.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    An Autonomous Decision-making Algorithm for Ship Collision Avoidance Based on DDQN with Prioritized Experience Replay


    Beteiligte:
    Niu, Yihan (Autor:in) / Zhu, Feixiang (Autor:in) / Zhai, Pengyu (Autor:in)


    Erscheinungsdatum :

    2023-08-04


    Format / Umfang :

    981907 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Ship collision avoidance decision-making method

    ZHANG JINFEN / ZENG YONG / ZHANG MINGYANG et al. | Europäisches Patentamt | 2020

    Freier Zugriff

    A prioritized collision avoidance methodology for autonomous driving

    Shahriari, Mohammadali / Biglarbegian, Mohammad | IEEE | 2016


    Collision avoidance decision-making method for autonomous vehicle

    WU BO / JIN GANG | Europäisches Patentamt | 2022

    Freier Zugriff

    Decision-Making Model for Multi-Ship Collision Avoidance Based on Adaptive Genetic Algorithm

    Hao, J.-l. / Zhao, L.-n. / Hu, J.-f. et al. | British Library Conference Proceedings | 2007