The objective of operation scheduling in container terminals is to determine a schedule that minimizes time for loading or unloading a given set of containers. This paper presents a method integrating reinforcement learning and simulation to optimize operation scheduling in container terminals. The introduced method uses a simulation model to construct the system environment while the Q-learning algorithm (reinforcement learning algorithm) is applied to learn optimal dispatching rules for different equipment (e.g. yard cranes, yard trailers). The optimal scheduling scheme is obtained by the interaction of the Q-learning algorithm and simulation environment. To evaluate the effectiveness of the proposed method, a lower bound is calculated considering the characteristics of the scheduling problem in container terminals. Finally, numerical experiments are provided to illustrate the validity of the proposed method.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    A method integrating simulation and reinforcement learning for operation scheduling in container terminals


    Beteiligte:
    Qingcheng Zeng (Autor:in) / Zhongzhen Yang (Autor:in) / Xiangpei Hu (Autor:in)


    Erscheinungsdatum :

    2012




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Unbekannt




    An integrating scheduling model for mixed cross-operation in container terminals

    Chao Chen / Qingcheng Zeng / Zhe Zhang | DOAJ | 2012

    Freier Zugriff

    Integrating truck arrival management into tactical operation planning at container terminals

    Yang, Zhong-Zhen / Chen, Gang / Song, Dong-Ping | Online Contents | 2013


    Scheduling reefer mechanics at container terminals

    Hartmann, Sönke | FID move | 2013

    Freier Zugriff

    Scheduling reefer mechanics at container terminals

    Hartmann, Sönke | Online Contents | 2013


    Optimization of Production Scheduling in Container Terminals Using Computer Simulation

    Zhang, J.-s. / Sha, M. / Easa, S. et al. | British Library Conference Proceedings | 2008