Heavy navigation demands of incoming/outgoing ships and operational features in dry bulk export terminals (DBETs) call for effective and intelligent optimization methods to improve navigation channel traffic and reduce delays. Considering ship deballasting delays in DBETs and their influences on channel traffic flow, this paper proposes a channel traffic scheduling (CTS) optimization method based on deep reinforcement learning (DRL). The CTS problem is formulated into a Markov decision process with tailored state and action definitions. Practical constraints, such as tidal windows and dynamic switching traffic mode, are incorporated into action selection processes. In coping with large state-action spaces caused by practical applications, a hierarchical DRL framework is proposed to perform layered decision-making. Relying on the reward signal design, DRL agents can learn optimization policies to produce integrated scheduling plans of channel traffic and ship deballasting operations while minimizing ship mooring, unberthing, and deballasting delays. A proximal policy optimization method is developed for coupling training DRL agents. Numerical experiments demonstrate that the proposed method can converge faster to better scheduling strategies and efficiently generate high-quality CTS solutions for industrial-scale applications.
Deep Reinforcement Learning for Channel Traffic Scheduling in Dry Bulk Export Terminals
IEEE Transactions on Intelligent Transportation Systems ; 25 , 11 ; 17547-17561
2024-11-01
3600233 byte
Article (Journal)
Electronic Resource
English
Optimized appointment scheduling for export container deliveries at marine terminals
Taylor & Francis Verlag | 2020
|British Library Online Contents | 2011
|