Heavy navigation demands of incoming/outgoing ships and operational features in dry bulk export terminals (DBETs) call for effective and intelligent optimization methods to improve navigation channel traffic and reduce delays. Considering ship deballasting delays in DBETs and their influences on channel traffic flow, this paper proposes a channel traffic scheduling (CTS) optimization method based on deep reinforcement learning (DRL). The CTS problem is formulated into a Markov decision process with tailored state and action definitions. Practical constraints, such as tidal windows and dynamic switching traffic mode, are incorporated into action selection processes. In coping with large state-action spaces caused by practical applications, a hierarchical DRL framework is proposed to perform layered decision-making. Relying on the reward signal design, DRL agents can learn optimization policies to produce integrated scheduling plans of channel traffic and ship deballasting operations while minimizing ship mooring, unberthing, and deballasting delays. A proximal policy optimization method is developed for coupling training DRL agents. Numerical experiments demonstrate that the proposed method can converge faster to better scheduling strategies and efficiently generate high-quality CTS solutions for industrial-scale applications.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Deep Reinforcement Learning for Channel Traffic Scheduling in Dry Bulk Export Terminals


    Contributors:
    Wang, Wenyuan (author) / Ding, Ao (author) / Cao, Zhen (author) / Peng, Yun (author) / Liu, Huakun (author) / Xu, Xinglu (author)

    Published in:

    Publication date :

    2024-11-01


    Size :

    3600233 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Optimized appointment scheduling for export container deliveries at marine terminals

    Li, Na / Chen, Gang / Ng, Manwo et al. | Taylor & Francis Verlag | 2020



    Disruption Management Approaches for Berth Scheduling in Bulk Terminals

    Alan Dávila de León / Eduardo Lalla-Ruiz / Belén Melián-Batista | DOAJ | 2022

    Free access

    A method integrating simulation and reinforcement learning for operation scheduling in container terminals

    Qingcheng Zeng / Zhongzhen Yang / Xiangpei Hu | DOAJ | 2012

    Free access