With the development of computer vision and Unmanned Aerial Vehicles (UAVs) technology, visual object tracking has become an indispensable core technology for UAVs, and it has been widely used in both civil and military fields. Visual object tracking from the UAV perspective experiences interference from various complex conditions such as background clutter, occlusion, and being out of view, which can easily lead to tracking drift. Once tracking drift occurs, it will lead to almost complete failure of the subsequent tracking. Currently, few trackers have been designed to solve the tracking drift problem. Thus, this paper proposes a tracking algorithm based on motion prediction and block search to address the tracking drift problem caused by various complex conditions. Specifically, when the tracker experiences tracking drift, we first use a Kalman filter to predict the motion state of the target, and then use a block search module to relocate the target. In addition, to improve the tracker’s ability to adapt to changes in the target’s appearance and the environment, we propose a dynamic template updating network (DTUN) that allows the tracker to make appropriate template decisions based on various tracking conditions. We also introduce three tracking evaluation metrics: namely, average peak correlation energy, size change ratio, and tracking score. They serve as prior information for tracking status identification in the DTUN and the block prediction module. Extensive experiments and comparisons with many competitive algorithms on five aerial benchmarks, UAV20L, UAV123, UAVDT, DTB70, and VisDrone2018-SOT, demonstrate that our method achieves significant performance improvements. Especially in UAV20L long-term tracking, our method outperforms the baseline in terms of success rate and accuracy by 19.1% and 20.8%, respectively. This demonstrates the superior performance of our method in the task of long-term tracking from the UAV perspective, and we achieve a real-time speed of 43 FPS.


    Access

    Download


    Export, share and cite



    Title :

    Visual Object Tracking Based on the Motion Prediction and Block Search in UAV Videos


    Contributors:
    Lifan Sun (author) / Xinxiang Li (author) / Zhe Yang (author) / Dan Gao (author)


    Publication date :

    2024




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    Unknown




    Object Tracking Using Background Subtraction and Motion Estimation in MPEG Videos

    Aggarwal, A. / Biswas, S. / Singh, S. et al. | British Library Conference Proceedings | 2006


    Motion Layer Based Object Removal in Videos

    Zhang, Yunjun / Xiao, Jiangjian / Shah, Mubarak | IEEE | 2005


    Structural similarity-based object tracking in multimodality surveillance videos

    Mihaylova, L. / Bull, D. / Canagarajah, N. | British Library Online Contents | 2009



    Object recognition and segmentation in videos by connecting heterogeneous visual features

    Gouet-Brunet, V. / Lameyre, B. | British Library Online Contents | 2008