Thermal sensors play an important role in intelligent transportation system. This paper studies the problem of RGB and thermal (RGBT) tracking in challenging situations by leveraging multimodal data. A RGBT object tracking method is proposed in correlation filter tracking framework based on short term historical information. Given the initial object bounding box, hierarchical convolutional neural network (CNN) is employed to extract features. The target is tracked for RGB and thermal modalities separately. Then the backward tracking is implemented in the two modalities. The difference between each pair is computed, which is an indicator of the tracking quality in each modality. Considering the temporal continuity of sequence frames, we also incorporate the history data into the weights computation to achieve a robust fusion of different source data. Experiments on three RGBT datasets show the proposed method achieves comparable results to state-of-the-art methods.
Adaptive Fusion CNN Features for RGBT Object Tracking
IEEE Transactions on Intelligent Transportation Systems ; 23 , 7 ; 7831-7840
01.07.2022
2624931 byte
Aufsatz (Zeitschrift)
Elektronische Ressource
Englisch
Dynamic Fusion Network for RGBT Tracking
IEEE | 2023
|Object tracking in an outdoor environment using fusion of features and cameras
British Library Online Contents | 2006
|