In the field of drone-based object tracking, utilization of the infrared modality can improve the robustness of the tracker in scenes with severe illumination change and occlusions and expand the applicable scene of the drone object tracking task. Inspired by the great achievements of Transformer structure in the field of RGB object tracking, we design a dual-modality object tracking network based on Transformer. To better address the problem of visible-infrared information fusion, we propose a Dual-Feature Aggregation Network that utilizes attention mechanisms in both spatial and channel dimensions to aggregate heterogeneous modality feature information. The proposed algorithm has achieved better performance by comparing with the mainstream algorithms in the drone-based dual-modality object tracking dataset VTUAV. Additionally, the algorithm is lightweight and can be easily deployed and executed on a drone edge computing platform. In summary, the proposed algorithm is mainly applicable to the field of drone dual-modality object tracking and the algorithm is optimized so that it can be deployed on the drone edge computing platform. The effectiveness of the algorithm is proved by experiments and the scope of drone object tracking is extended effectively.


    Access

    Download


    Export, share and cite



    Title :

    Drone Based RGBT Tracking with Dual-Feature Aggregation Network


    Contributors:
    Zhinan Gao (author) / Dongdong Li (author) / Gongjian Wen (author) / Yangliu Kuai (author) / Rui Chen (author)


    Publication date :

    2023




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Quality-Aware Feature Aggregation Network for Robust RGBT Tracking

    Zhu, Yabin / Li, Chenglong / Tang, Jin et al. | IEEE | 2021


    Dynamic Fusion Network for RGBT Tracking

    Peng, Jingchao / Zhao, Haitao / Hu, Zhengwei | IEEE | 2023


    Adaptive Fusion CNN Features for RGBT Object Tracking

    Wang, Yong / Wei, Xian / Tang, Xuan et al. | IEEE | 2022


    DRONE-BASED TRACKING

    BENNIE BRIAN / NEUBECKER CYNTHIA M / IGNACZAK BRAD ALAN et al. | European Patent Office | 2020

    Free access

    DRONE-BASED TRACKING

    BENNIE BRIAN / NEUBECKER CYNTHIA / IGNACZAK BRAD et al. | European Patent Office | 2018

    Free access