Video object segmentation (VOS) is the fundamental problem of vision-based intelligent transportation, and many VOS algorithms relying on inference from reference masks have been proposed. Due to the inherent defects of the inference strategy and the complex changes of targets, VOS methods that perform well on public datasets are usually ineffective in airport scenarios. We propose a spatiotemporal alignment network (STA-Net) that makes use of Automatic Dependent Surveillance-Broadcast (ADS-B) data as prior information to guide the long-term segmentation of aircraft. ADS-B is an airport-specific signal, which indicates the location of aircraft in real time. Based on ADS-B, we continuously generate new reference masks instead of using previous masks for inference, which greatly reduces the accumulation of inference errors. To achieve this, previous masks of each aircraft are aligned on the temporal domain based on the position information in ADS-B. All temporally-aligned masks are compared, and the one most similar to the current instant is reserved. This mask is both temporally and spatially aligned; hence it is a better reference mask for inference. Aligned masks are updated every time new ADS-B data arrive, so that they can support long-term inference. With the selected mask as a reference, aircraft of interest are segmented within a unified encoder-decoder framework over the long term. Experiments on a benchmark dataset and in a real airport scenario verify the effectiveness of the presented method.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    ADS-B-Based Spatiotemporal Alignment Network for Airport Video Object Segmentation


    Contributors:
    Zhang, Xiang (author) / Wang, Shuai (author) / Wu, Honggang (author) / Liu, Zhi (author) / Wu, Celimuge (author)

    Published in:

    Publication date :

    2022-10-01


    Size :

    4410312 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English





    Spatiotemporal Object Database Approach to Dynamic Segmentation

    Huang, Bo / Yao, Li | Transportation Research Record | 2003


    Foreign object debris detection for airport runway with video data

    Weishi, Chen / Jing, Li | British Library Online Contents | 2014


    Video Object Segmentation Based on Gaussian Mixture Model

    Xiaohe, L. / Taiyi, Z. / Yatong, Z. | British Library Online Contents | 2006