Li, DonghaoShen, CeHu, JinxingYuan, DipingSiamese trackers have achieved remarkable performance in accuracy. However, the high memory cost and inference speed have restricted the deployment of the state-of-the-art trackers in mobile applications. To address this issue, this paper presents a backbone consisting of multiplexing convolution blocks that newly proposed by us, which combine the spatial multiplexing operation and channel multiplexing operation. The spatial multiplexing operation is inspired by the subpixel convolution in super-resolution tasks. The channel multiplexing operation is inspired by the channel shuffle in ShuffleNet. These two modules can be used to effectively optimize the multiply–accumulate (MACC) operation, by multiplying the number of operations and then adding it to a network. We employ this new module to build a novel lightweight backbone for the SiamRPN++ tracker. We trained this model and evaluated its performances on the VOT2018 and OTB2015 datasets. Our model is compressed to 43 MB, the inference time was 83 FPS, and the experiments were carried out in a single NVIDIA 2080Ti GPU. Our model is superior to MobileNetv2-SiamRPN++, which has a model size of 58 MB and the inference time of 55 FPS, and our method also managed to reduce the MACC from 1.2 to 0.5 B. Compared with SiamRPN++ with Resnet50 backbone, our model achieved a compression rate of 4.8 × \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\times $$\end{document} and speedup of 3.3 × \documentclass[12pt]{minimal} \usepackage{amsmath} \usepackage{wasysym} \usepackage{amsfonts} \usepackage{amssymb} \usepackage{amsbsy} \usepackage{mathrsfs} \usepackage{upgreek} \setlength{\oddsidemargin}{-69pt} \begin{document}$$\times $$\end{document}, just losing 3% EAO.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MPSiam: A Fast Multiplexing Siamese Tracking Network


    Additional title:

    Smart Innovation, Systems and Technologies


    Contributors:
    Wu, Tsu-Yang (editor) / Ni, Shaoquan (editor) / Chu, Shu-Chuan (editor) / Chen, Chi-Hua (editor) / Favorskaya, Margarita (editor) / Li, Donghao (author) / Shen, Ce (author) / Hu, Jinxing (author) / Yuan, Diping (author)


    Publication date :

    2021-11-30


    Size :

    8 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    MPSiam: A Fast Multiplexing Siamese Tracking Network

    Li, Donghao / Shen, Ce / Hu, Jinxing et al. | TIBKAT | 2022


    Siamese Adaptive Transformer Network for Real-Time Aerial Tracking

    Xing, Daitao / Tsoukalas, Athanasios / Evangeliou, Nikolaos et al. | IEEE | 2022


    Vehicle tracking method and Siamese network training method and device

    LU HONGZHI | European Patent Office | 2021

    Free access

    STFTrack: Spatio-Temporal-Focused Siamese Network for Infrared UAV Tracking

    Xueli Xie / Jianxiang Xi / Xiaogang Yang et al. | DOAJ | 2023

    Free access

    Siamese-ResNet: Implementing Loop Closure Detection based on Siamese Network

    Qiu, Kai / Ai, Yunfeng / Tian, Bin et al. | IEEE | 2018