Drone aerial videos have immense potential in surveillance, rescue, agriculture, and urban planning. However, accurately tracking multiple objects in drone aerial videos faces challenges like occlusion, scale variations, and rapid motion. Current joint detection and tracking methods often compromise accuracy. We propose a drone multiple object tracking algorithm based on a holistic transformer and multiple feature trajectory matching pattern to overcome these challenges. The holistic transformer captures local and global interaction information, providing precise detection and appearance features for tracking. The tracker includes three components: preprocessing, trajectory prediction, and matching. Preprocessing categorizes detection boxes based on scores, with each category adopting specific matching rules. Trajectory prediction employs the visual Gaussian mixture probability hypothesis density method to integrate visual detection results to forecast object motion accurately. The multiple feature pattern introduces Gaussian, Appearance, and Optimal subpattern assignment distances for different detection box types (GAO trajectory matching pattern) in the data association process, enhancing tracking robustness. We perform comparative validations on the vision-meets-drone (VisDrone) and the unmanned aerial vehicle benchmarks; the object detection and tracking (UAVDT) datasets affirm the algorithm’s effectiveness: it obtained 38.8% and 61.7% MOTA, respectively. Its potential for seamless integration into practical engineering applications offers enhanced situational awareness and operational efficiency in drone-based missions.


    Access

    Download


    Export, share and cite



    Title :

    Multiple Object Tracking in Drone Aerial Videos by a Holistic Transformer and Multiple Feature Trajectory Matching Pattern


    Contributors:
    Yubin Yuan (author) / Yiquan Wu (author) / Langyue Zhao (author) / Yaxuan Pang (author) / Yuqi Liu (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    3D Object Trajectory Reconstruction using Stereo Matching and Instance Flow based Multiple Object Tracking

    Bullinger, Sebastian / Bodensteiner, Christoph / Arens, Michael | BASE | 2019

    Free access

    An algorithm for multiple object trajectory tracking

    Mei Han, / Wei Xu, / Hai Tao, et al. | IEEE | 2004


    An Algorithm for Multiple Object Trajectory Tracking

    Han, M. / Xu, W. / Tao, H. et al. | British Library Conference Proceedings | 2004



    Object Tracking across Multiple Independently Moving Aerial Cameras

    Sheikh, Y. / Shah, M. / IEEE | British Library Conference Proceedings | 2005