RGB-Infrared object detection is an essential technology for the intelligent transportation system. Existing most works on RGB-Infrared object detection focus on how to fuse RGB and infrared features. However, these works overlook the inherent differences between RGB and infrared modalities, leading to insufficient modal feature fusion and limiting the performance of RGB-Infrared object detection. To address the above issues, a Specificity-guided Cross-modal Feature Reconstruction(SCFR) algorithm is proposed to establish modality-specific correlation for RGB-Infrared object detection. Specifically, the proposed SCFR involves the modality-specific cross-modal feature reconstruction network and two modality-specific losses. The modality-specific cross-modal feature reconstruction network performs cross-modal feature reconstruction on RGB and infrared modalities to establish modality-specific correlation. The modality-specific losses guide the direction of feature learning for reconstructing the expressive modality-specific features. These specific features can be used to achieve more efficient feature fusion, thus improving object detection performance. Comprehensive experimental results on three RGB-Infrared detection datasets demonstrate the effectiveness and the superiority of the proposed method. Our code will be available at https://github.com/SXYSUOSUO/SCFR.git.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Specificity-Guided Cross-Modal Feature Reconstruction for RGB-Infrared Object Detection


    Beteiligte:
    Sun, Xiaoyu (Autor:in) / Zhu, Yaohui (Autor:in) / Huang, Hua (Autor:in)


    Erscheinungsdatum :

    01.01.2025


    Format / Umfang :

    3115173 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Multi-Modal Feature Pyramid Transformer for RGB-Infrared Object Detection

    Zhu, Yaohui / Sun, Xiaoyu / Wang, Miao et al. | IEEE | 2023


    FEGNet: A feature enhancement and guided network for infrared object detection in underground mines

    Huang, Lisha / Zhang, Xi / Yu, Miao et al. | SAGE Publications | 2024


    Frustum FusionNet: Amodal 3D Object Detection with Multi-Modal Feature Fusion

    Zuo, Liangyu / Li, Yaochen / Han, Mengtao et al. | IEEE | 2021


    Label Guided Discrete Hashing for Cross-Modal Retrieval

    Lan, Rushi / Tan, Yu / Wang, Xiaoqin et al. | IEEE | 2022