In order to reduce the influence of human factors on ship collision avoidance, this paper proposes an autonomous collision avoidance decision-making algorithm based on Double Deep Q Network (DDQN) with prioritized experience replay (PER). Based on a full understanding of the International Regulations for Preventing Collision at Sea (COLREGs), and the reward function of the autonomous collision avoidance decision-making algorithm is guided and designed in terms of the number of rudder operations, the amount of the cumulative steering angle during the avoidance process, the DCPA when clear of the other ship, the deviation distance at the end of the avoidance, the total magnitude of ship heading changes during the avoidance process and rule compliance by combining with the statistical results of real water traffic data. Ship encounter scenarios are constructed based on COLREGs, which are arranged and combined the sample training and testing sets for the agent; We compare the algorithm proposed in this paper with DQN, DQN with prioritized experience replay and DDQN algorithms by simulating the same encounter scenario, using this as the training set for the model; Finally, multi-ship encounter scenario simulations are set up as the testing set for the model to verify the performance of the algorithm. The results show that compared with three other reinforcement learning algorithms, DDQN with prioritized experience replay algorithm can make ship collision avoidance decision-making more efficient and improve the safety of ship autonomous navigation under COLREGs; and the trained model can be replicated and applied to a system with any number of agents to provide a reference for ship autonomous collision avoidance research.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    An Autonomous Decision-making Algorithm for Ship Collision Avoidance Based on DDQN with Prioritized Experience Replay


    Contributors:
    Niu, Yihan (author) / Zhu, Feixiang (author) / Zhai, Pengyu (author)


    Publication date :

    2023-08-04


    Size :

    981907 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Ship collision avoidance decision-making method

    ZHANG JINFEN / ZENG YONG / ZHANG MINGYANG et al. | European Patent Office | 2020

    Free access

    A prioritized collision avoidance methodology for autonomous driving

    Shahriari, Mohammadali / Biglarbegian, Mohammad | IEEE | 2016


    Collision avoidance decision-making method for autonomous vehicle

    WU BO / JIN GANG | European Patent Office | 2022

    Free access

    Decision-Making Model for Multi-Ship Collision Avoidance Based on Adaptive Genetic Algorithm

    Hao, J.-l. / Zhao, L.-n. / Hu, J.-f. et al. | British Library Conference Proceedings | 2007