Owing to the expansion in processing of industrial information through advances in machine learning, the demand for accurate crowd counting in various applications is increasing. We propose a multimodality cross-guided compensation coordination network (MC3Net) for accurate red–green–blue and thermal (RGB-T) crowd counting. The network includes modules of intricate interactive fusion, feature difference compensation, and complementary attention enhancement. We use ConvNext as the backbone and process the three streams from RGB, thermal, and spliced RGB-T inputs. The multimodality data are sequentially guided and fused hierarchically, fully combining features extracted from the RGB and thermal images. Thereafter, difference compensation is applied to compress fusion and splicing features. Redundant information is removed. Then, feature mismatch is mitigated to enhance complementary information, reduce the loss of details, and finally obtain crowd statistics. Results from extensive experiments on the RGBT-CC dataset indicate the robustness and effectiveness of MC3Net, which also achieves high performance on the DroneRGBT dataset and ShanghaiTechRGBD dataset, outperforming existing crowd counting methods. The code and models are available at: https://github.com/WBangG/MC3Net.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MC3Net: Multimodality Cross-Guided Compensation Coordination Network for RGB-T Crowd Counting


    Contributors:
    Zhou, Wujie (author) / Yang, Xun (author) / Lei, Jingsheng (author) / Yan, Weiqing (author) / Yu, Lu (author)


    Publication date :

    2024-05-01


    Size :

    8130761 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    A Crowd Counting Framework Combining with Crowd Location

    Jin Zhang / Sheng Chen / Sen Tian et al. | DOAJ | 2021

    Free access

    WiFi-Crowd Spy: A novel crowd-counting system

    Collaguazo, Adriana / Estrada, Rebeca / Valeriano, Irving et al. | IEEE | 2022


    CACrowdGAN: Cascaded Attentional Generative Adversarial Network for Crowd Counting

    Zhu, Aichun / Zheng, Zhe / Huang, Yaoying et al. | IEEE | 2022


    Drone-SCNet: Scaled Cascade Network for Crowd Counting on Drone Images

    Elharrouss, Omar / Almaadeed, Noor / Abualsaud, Khalid et al. | IEEE | 2021