Benefiting from the powerful feature extraction capability of deep learning, the Siamese tracker stands out due to its advanced tracking performance. However, constrained by the complex backgrounds of aerial tracking, such as low resolution, occlusion, similar objects, small objects, scale variation, aspect ratio change, deformation and limited computational resources, efficient and accurate aerial tracking is still difficult to realize. In this work, we design a lightweight and efficient adaptive temporal contextual aggregation Siamese network for aerial tracking, which is designed with a parallel atrous module (PAM) and adaptive temporal context aggregation model (ATCAM) to mitigate the above problems. Firstly, by using a series of atrous convolutions with different dilation rates in parallel, the PAM can simultaneously extract and aggregate multi-scale features with spatial contextual information at the same feature map, which effectively improves the ability to cope with changes in target appearance caused by challenges such as aspect ratio change, occlusion, scale variation, etc. Secondly, the ATCAM adaptively introduces temporal contextual information to the target frame through the encoder-decoder structure, which helps the tracker resist interference and recognize the target when it is difficult to extract high-resolution features such as low-resolution, similar objects. Finally, experiments on the UAV20L, UAV123@10fps and DTB70 benchmarks demonstrate the impressive performance of the proposed network running at a high speed of over 75.5 fps on the NVIDIA 3060Ti.


    Access

    Download


    Export, share and cite



    Title :

    Lightweight Spatial-Temporal Contextual Aggregation Siamese Network for Unmanned Aerial Vehicle Tracking


    Contributors:
    Qiqi Chen (author) / Jinghong Liu (author) / Faxue Liu (author) / Fang Xu (author) / Chenglong Liu (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Spatial-Temporal Contextual Aggregation Siamese Network for UAV Tracking

    Qiqi Chen / Xuan Wang / Faxue Liu et al. | DOAJ | 2024

    Free access

    A Motion-Aware Siamese Framework for Unmanned Aerial Vehicle Tracking

    Lifan Sun / Jinjin Zhang / Zhe Yang et al. | DOAJ | 2023

    Free access

    SiamMAN: Siamese Multi-Phase Aware Network for Real-Time Unmanned Aerial Vehicle Tracking

    Faxue Liu / Xuan Wang / Qiqi Chen et al. | DOAJ | 2023

    Free access

    SiamCTCA: Cross-Temporal Correlation Aggregation Siamese Network for UAV Tracking

    Qiaochu Wang / Faxue Liu / Bao Zhang et al. | DOAJ | 2025

    Free access

    Lightweight multifunctional unmanned aerial vehicle

    YANG KUN / LONG YONG / ZHANG PENGYU | European Patent Office | 2025

    Free access