Owing to the expansion in processing of industrial information through advances in machine learning, the demand for accurate crowd counting in various applications is increasing. We propose a multimodality cross-guided compensation coordination network (MC3Net) for accurate red–green–blue and thermal (RGB-T) crowd counting. The network includes modules of intricate interactive fusion, feature difference compensation, and complementary attention enhancement. We use ConvNext as the backbone and process the three streams from RGB, thermal, and spliced RGB-T inputs. The multimodality data are sequentially guided and fused hierarchically, fully combining features extracted from the RGB and thermal images. Thereafter, difference compensation is applied to compress fusion and splicing features. Redundant information is removed. Then, feature mismatch is mitigated to enhance complementary information, reduce the loss of details, and finally obtain crowd statistics. Results from extensive experiments on the RGBT-CC dataset indicate the robustness and effectiveness of MC3Net, which also achieves high performance on the DroneRGBT dataset and ShanghaiTechRGBD dataset, outperforming existing crowd counting methods. The code and models are available at: https://github.com/WBangG/MC3Net.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    MC3Net: Multimodality Cross-Guided Compensation Coordination Network for RGB-T Crowd Counting


    Beteiligte:
    Zhou, Wujie (Autor:in) / Yang, Xun (Autor:in) / Lei, Jingsheng (Autor:in) / Yan, Weiqing (Autor:in) / Yu, Lu (Autor:in)


    Erscheinungsdatum :

    2024-05-01


    Format / Umfang :

    8130761 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Spatio-Channel Attention Blocks for Cross-modal Crowd Counting

    Zhang, Youjia / Choi, Soyun / Hong, Sungeun | British Library Conference Proceedings | 2023


    A Crowd Counting Framework Combining with Crowd Location

    Jin Zhang / Sheng Chen / Sen Tian et al. | DOAJ | 2021

    Freier Zugriff

    CACrowdGAN: Cascaded Attentional Generative Adversarial Network for Crowd Counting

    Zhu, Aichun / Zheng, Zhe / Huang, Yaoying et al. | IEEE | 2022


    RGB-T Crowd Counting from Drone: A Benchmark and MMCCN Network

    Peng, Tao / Li, Qing / Zhu, Pengfei | British Library Conference Proceedings | 2021