RGBT tracking is a task that utilizes images from visible (RGB) and thermal infrared (TIR) modalities to continuously locate a target, which plays an important role in various fields including intelligent transportation systems. Most existing RGBT trackers do not achieve high precision and real-time tracking speed simultaneously. To address this challenge, we propose an innovative RGBT tracker, the Siamese Triple-stream Feature Aggregation Network (SiamTFA). Firstly, a triple-stream backbone is presented to implement multi-modal feature extraction and fusion, which contains two parallel Swin Transformer feature extraction streams, and one feature fusion stream composed of joint-complementary feature aggregation (JCFA) modules. Secondly, our proposed JCFA module utilizes a joint-complementary attention to guide the aggregation of multi-modal features. Specifically, the joint attention can focus on spatial location information and semantic information of the target by combining the features of two modalities. Considering the complementarity between RGB and TIR modalities, the complementary attention is introduced to enhance the information of beneficial modality and suppress the information of ineffective modality. Thirdly, in order to reduce the computational complexity of the joint-complementary attention, we propose a depthwise shared attention structure, which utilizes depthwise convolution and shared features to achieve lightweight attention. Finally, we conduct extensive experiments on four official RGBT test datasets and the experimental results demonstrate that our proposed tracker outperforms some state-of-the-art trackers and the tracking speed reaches 37 frames per second (FPS). The code is available at https://github.com/zjjqinyu/SiamTFA.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SiamTFA: Siamese Triple-Stream Feature Aggregation Network for Efficient RGBT Tracking


    Contributors:
    Zhang, Jianming (author) / Qin, Yu (author) / Fan, Shimeng (author) / Xiao, Zhu (author) / Zhang, Jin (author)


    Publication date :

    2025-02-01


    Size :

    3648319 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Drone Based RGBT Tracking with Dual-Feature Aggregation Network

    Zhinan Gao / Dongdong Li / Gongjian Wen et al. | DOAJ | 2023

    Free access

    Quality-Aware Feature Aggregation Network for Robust RGBT Tracking

    Zhu, Yabin / Li, Chenglong / Tang, Jin et al. | IEEE | 2021


    Dynamic Fusion Network for RGBT Tracking

    Peng, Jingchao / Zhao, Haitao / Hu, Zhengwei | IEEE | 2023


    Spatial-Temporal Contextual Aggregation Siamese Network for UAV Tracking

    Qiqi Chen / Xuan Wang / Faxue Liu et al. | DOAJ | 2024

    Free access

    SiamCTCA: Cross-Temporal Correlation Aggregation Siamese Network for UAV Tracking

    Qiaochu Wang / Faxue Liu / Bao Zhang et al. | DOAJ | 2025

    Free access