Large-scale deployed cameras in the automated container terminal (ACT) area helps on-site staff better identify unexpected yet emergency events by monitoring port personnel trajectories. Rainy weather is ${a}$ common yet typical problem which may significantly deteriorate trajectory extraction performance. To tackle the problem, the study proposes an ensemble framework to extract personnel trajectory from port-like surveillance videos under varied rainy weather scenarios. Firstly, the proposed framework learns fine-grained personnel features with the help of the object query and transformer encoder-decoder module from the input port-like image sequences, and thus obtains port personnel locations from the input low-visibility images. Secondly, the personnel positions are further associated in a frame-by-frame manner with the help of neighboring kinematic movement information and feature information. Finally, a memory mechanism is introduced in the proposed framework to suppress personnel trajectory discontinuity outlier. In that manner, we can obtain accurate yet consistent personnel trajectories, and each person is assigned with a unique ID. We verified the proposed model performance on three port-like rainy videos involving with interferences of rain, rain streak and fog. Experimental results show that the proposed port personnel trajectory extraction framework can obtain satisfied performance considering that the average multi-target accuracy (MOTA), the average value of judging the same target ( ${\mathbf {IDF}}_{\mathbf {1}}$ ), average recall rate (IDR) and average precision (IDP) were larger than 92%.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Personnel Trajectory Extraction From Port-Like Videos Under Varied Rainy Interferences


    Contributors:


    Publication date :

    2024-07-01


    Size :

    7611172 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    AI-Empowered Speed Extraction via Port-Like Videos for Vehicular Trajectory Analysis

    Chen, Xinqiang / Wang, Zichuang / Hua, Qiaozhi et al. | IEEE | 2023


    High-Resolution Vehicle Trajectory Extraction and Denoising From Aerial Videos

    Chen, Xinqiang / Li, Zhibin / Yang, Yongsheng et al. | IEEE | 2021