Color–thermal (RGB-T) urban scene parsing has recently attracted widespread interest. However, most existing approaches to RGB-T urban scene parsing do not deeply explore the information complementarity between RGB-T features. In this study, we propose a cross-modal attention-cascaded fusion network (CACFNet) that fully exploits cross-modality. In our design, a cross-modal attention fusion module mines complementary information from two modalities. Subsequently, a cascaded fusion module decodes the multi-level features in an up-bottom manner. Noting that each pixel is labeled with the category of the region to which it belongs, we present a region-based module that explores the relationship between pixel and region. Moreover, in contrast to previous methods that employ only the cross-entropy loss to penalize pixel-wise predictions, we propose an additional loss to learn pixel–pixel relationships. Extensive experiments on two datasets demonstrate that the proposed CACFNet achieves state-of-the-art performance in RGB-T urban scene parsing.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    CACFNet: Cross-Modal Attention Cascaded Fusion Network for RGB-T Urban Scene Parsing


    Beteiligte:
    Zhou, Wujie (Autor:in) / Dong, Shaohua (Autor:in) / Fang, Meixin (Autor:in) / Yu, Lu (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2024-01-01


    Format / Umfang :

    2524402 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing

    Dong, Shaohua / Zhou, Wujie / Xu, Caie et al. | IEEE | 2024


    Scene Parsing and Fusion-Based Continuous Traversable Region Formation

    Xiao, Xuhong / Ng, Gee Wah / Tan, Yuan Sin et al. | British Library Conference Proceedings | 2015


    Pyramid Scene Parsing Network for Driver Distraction Classification

    Khadraoui, Abdelhak / Zemmouri, Elmoukhtar | Springer Verlag | 2024


    Cross-modal links in spatial attention

    Driver, J. / Spence, C. / Royal Society; Great Britain| Novartis Foundation for Gerontological Research | British Library Conference Proceedings | 1999