RGBT tracking becomes a popular computer vision task, and has a variety of applications in visual surveillance systems, self-driving cars and intelligent transportation system. This paper investigates how to perform robust visual tracking in adverse and challenging conditions using complementary visual and thermal infrared data (RGBT tracking). We propose a novel deep network architecture called quality-aware Feature Aggregation Network (FANet) for robust RGBT tracking. Unlike existing RGBT trackers, our FANet aggregates hierarchical deep features within each modality to dispose the challenge of significant changes in appearance which is triggered by low illumination,deformation, background clutter and occlusion. In particular, we employ the operations of max pooling to transform these hierarchical and multi-resolution features into uniform space with the same resolution, and use 1×1 convolution operation to compress feature dimensions to achieve more effective hierarchical feature aggregation. To model the interactions between RGB and thermal modalities, we elaborately design an adaptive aggregation subnetwork to integrate features from different modalities based on their reliabilities and thus are able to alleviate noise effects introduced by low-quality sources. The whole FANet is trained in an end-to-end manner. Extensive experiments on large-scale benchmark datasets demonstrate the high-accurate performance against other state-of-the-art RGBT tracking methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Quality-Aware Feature Aggregation Network for Robust RGBT Tracking


    Beteiligte:
    Zhu, Yabin (Autor:in) / Li, Chenglong (Autor:in) / Tang, Jin (Autor:in) / Luo, Bin (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2021-03-01


    Format / Umfang :

    3280996 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Drone Based RGBT Tracking with Dual-Feature Aggregation Network

    Zhinan Gao / Dongdong Li / Gongjian Wen et al. | DOAJ | 2023

    Freier Zugriff

    Dynamic Fusion Network for RGBT Tracking

    Peng, Jingchao / Zhao, Haitao / Hu, Zhengwei | IEEE | 2023


    Adaptive Fusion CNN Features for RGBT Object Tracking

    Wang, Yong / Wei, Xian / Tang, Xuan et al. | IEEE | 2022


    Algorithmic Fusion for More Robust Feature Tracking

    McCane, B. / Galvin, B. / Novins, K. | British Library Online Contents | 2002


    Global motion-aware robust visual object tracking for electro optical targeting systems

    Kim, Byeong Hak / Lukežič, Alan / Lee, Jong Hyuk et al. | BASE | 2021

    Freier Zugriff