The semantic segmentation of road scenes is an important task in autonomous driving. Deep learning has enabled the development of a variety of semantic segmentation networks using RGB and depth data. However, poor lighting conditions and long-distance sensing limit the applicability of RGB and depth cameras. Nevertheless, many existing methods still rely on precise depth maps for scene segmentation. Unlike depth information, thermal imaging provides a visual heat representation that remains accurate under a variety of lighting conditions and over longer distances. For robust and accurate segmentation of scenes collected during autonomous driving, we used the advanced MobileNetV2 network for feature extraction and a fusion strategy with an embedded control gate. In addition, we adopted an encoder–decoder scheme for semantic segmentation and developed an attention residual learning strategy to restore the resolution of the feature map. Finally, semantic and boundary supervision is introduced to optimize parameters of the proposed network. Experimental results show that the proposed network outperforms existing networks on segmentation of urban scenes, and our network can be generalized to depth data.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Embedded Control Gate Fusion and Attention Residual Learning for RGB–Thermal Urban Scene Parsing


    Beteiligte:
    Zhou, Wujie (Autor:in) / Lv, Ying (Autor:in) / Lei, Jingsheng (Autor:in) / Yu, Lu (Autor:in)


    Erscheinungsdatum :

    01.05.2023


    Format / Umfang :

    1634146 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    CACFNet: Cross-Modal Attention Cascaded Fusion Network for RGB-T Urban Scene Parsing

    Zhou, Wujie / Dong, Shaohua / Fang, Meixin et al. | IEEE | 2024


    EGFNet: Edge-Aware Guidance Fusion Network for RGB–Thermal Urban Scene Parsing

    Dong, Shaohua / Zhou, Wujie / Xu, Caie et al. | IEEE | 2024



    Spatial Prior for Nonparametric Road Scene Parsing

    Di, Shuai / Zhang, Honggang / Mei, Xue et al. | IEEE | 2015


    Exploiting Large Image Sets for Road Scene Parsing

    Alvarez, Jose M | Online Contents | 2016