Thermal sensors play an important role in intelligent transportation system. This paper studies the problem of RGB and thermal (RGBT) tracking in challenging situations by leveraging multimodal data. A RGBT object tracking method is proposed in correlation filter tracking framework based on short term historical information. Given the initial object bounding box, hierarchical convolutional neural network (CNN) is employed to extract features. The target is tracked for RGB and thermal modalities separately. Then the backward tracking is implemented in the two modalities. The difference between each pair is computed, which is an indicator of the tracking quality in each modality. Considering the temporal continuity of sequence frames, we also incorporate the history data into the weights computation to achieve a robust fusion of different source data. Experiments on three RGBT datasets show the proposed method achieves comparable results to state-of-the-art methods.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Adaptive Fusion CNN Features for RGBT Object Tracking


    Contributors:
    Wang, Yong (author) / Wei, Xian (author) / Tang, Xuan (author) / Shen, Hao (author) / Zhang, Huanlong (author)


    Publication date :

    2022-07-01


    Size :

    2624931 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Dynamic Fusion Network for RGBT Tracking

    Peng, Jingchao / Zhao, Haitao / Hu, Zhengwei | IEEE | 2023


    Drone Based RGBT Tracking with Dual-Feature Aggregation Network

    Zhinan Gao / Dongdong Li / Gongjian Wen et al. | DOAJ | 2023

    Free access

    Quality-Aware Feature Aggregation Network for Robust RGBT Tracking

    Zhu, Yabin / Li, Chenglong / Tang, Jin et al. | IEEE | 2021


    SiamTFA: Siamese Triple-Stream Feature Aggregation Network for Efficient RGBT Tracking

    Zhang, Jianming / Qin, Yu / Fan, Shimeng et al. | IEEE | 2025


    Object tracking in an outdoor environment using fusion of features and cameras

    Zhou, Q. / Aggarwal, J. K. | British Library Online Contents | 2006