RGB-Infrared object detection is an essential technology for the intelligent transportation system. Existing most works on RGB-Infrared object detection focus on how to fuse RGB and infrared features. However, these works overlook the inherent differences between RGB and infrared modalities, leading to insufficient modal feature fusion and limiting the performance of RGB-Infrared object detection. To address the above issues, a Specificity-guided Cross-modal Feature Reconstruction(SCFR) algorithm is proposed to establish modality-specific correlation for RGB-Infrared object detection. Specifically, the proposed SCFR involves the modality-specific cross-modal feature reconstruction network and two modality-specific losses. The modality-specific cross-modal feature reconstruction network performs cross-modal feature reconstruction on RGB and infrared modalities to establish modality-specific correlation. The modality-specific losses guide the direction of feature learning for reconstructing the expressive modality-specific features. These specific features can be used to achieve more efficient feature fusion, thus improving object detection performance. Comprehensive experimental results on three RGB-Infrared detection datasets demonstrate the effectiveness and the superiority of the proposed method. Our code will be available at https://github.com/SXYSUOSUO/SCFR.git.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Specificity-Guided Cross-Modal Feature Reconstruction for RGB-Infrared Object Detection


    Contributors:
    Sun, Xiaoyu (author) / Zhu, Yaohui (author) / Huang, Hua (author)


    Publication date :

    2025-01-01


    Size :

    3115173 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Multi-Modal Feature Pyramid Transformer for RGB-Infrared Object Detection

    Zhu, Yaohui / Sun, Xiaoyu / Wang, Miao et al. | IEEE | 2023


    FEGNet: A feature enhancement and guided network for infrared object detection in underground mines

    Huang, Lisha / Zhang, Xi / Yu, Miao et al. | SAGE Publications | 2024


    Frustum FusionNet: Amodal 3D Object Detection with Multi-Modal Feature Fusion

    Zuo, Liangyu / Li, Yaochen / Han, Mengtao et al. | IEEE | 2021


    Label Guided Discrete Hashing for Cross-Modal Retrieval

    Lan, Rushi / Tan, Yu / Wang, Xiaoqin et al. | IEEE | 2022