Since both visible and infrared images have their own advantages and disadvantages, RGBT tracking plays an important role in intelligent transportation systems. The key points of RGBT tracking lie in feature extraction and fusion of visible and infrared images. Current RGBT tracking methods mostly pay attention to both individual features (features extracted from images of a single camera) and common features (features extracted and fused from an RGB camera and a thermal camera). Still, they pay less attention to different and dynamic contributions of the individual and common features for different sequences of registered image pairs. This paper proposes a novel RGBT tracking method, called Dynamic Fusion Network (DFNet), which adopts a two-stream structure, in which two non-shared convolution kernels are employed in each layer to extract individual features. Besides, DFNet has shared convolution kernels for each layer to extract common features. Since non-shared and shared convolution kernels are adaptively weighted and summed according to different image pairs, DFNet can deal with different contributions for different sequences. DFNet has a fast speed, which is 28.658 FPS. The experimental results show that when DFNet only increases the Mult-Adds by 0.02% compared with the non-shared-convolution-kernel-based fusion method, Precision Rate (PR) and Success Rate (SR) reach 88.1% and 71.9%, respectively. The model and dataset are available at https://github.com/PengJingchao/DFNet.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Dynamic Fusion Network for RGBT Tracking


    Contributors:


    Publication date :

    2023-04-01


    Size :

    4671857 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Adaptive Fusion CNN Features for RGBT Object Tracking

    Wang, Yong / Wei, Xian / Tang, Xuan et al. | IEEE | 2022


    Quality-Aware Feature Aggregation Network for Robust RGBT Tracking

    Zhu, Yabin / Li, Chenglong / Tang, Jin et al. | IEEE | 2021


    Drone Based RGBT Tracking with Dual-Feature Aggregation Network

    Zhinan Gao / Dongdong Li / Gongjian Wen et al. | DOAJ | 2023

    Free access

    Learning a Dynamic Feature Fusion Tracker for Object Tracking

    Li, Zhiyong / Nai, Ke / Li, Guiji et al. | IEEE | 2022


    Fusion of Object Tracking and Dynamic Occupancy Grid Map

    Rexin, Nils / Musch, Marcel / Dietmayer, Klaus | IEEE | 2019