Semantic segmentation is an important technique for scene understanding in the intelligent transportation system. RGB-D data shows great advantages over the unimodal data in this area, and it can be easily obtained from consumer sensors nowadays. How to design effective fusion structures to fuse RGB and depth signals in RGB-D data is a challenging problem. This paper proposes a novel gated-residual block to address this problem. The structure consists of two residual units and one gated fusion unit, the residual unit progressively aggregates modality-specific features from the modality-specific signals and the gate mechanism computes complementary features for them. Based on the gated-residual block, the paper presents the deep multimodal networks, named GRBNet, for RGB-D semantic segmentation. Experiments on ScanNet, Cityscapes and SUN RGB-D datasets verify the effectiveness of the proposed approach and demonstrate that the GRBNet achieved competitive performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Gated-Residual Block for Semantic Segmentation Using RGB-D Data


    Contributors:
    Qian, Yeqiang (author) / Deng, Liuyuan (author) / Li, Tianyi (author) / Wang, Chunxiang (author) / Yang, Ming (author)


    Publication date :

    2022-08-01


    Size :

    1848758 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Convolutional gated recurrent networks for video semantic segmentation in automated driving

    Siam, Mennatullah / Valipour, Sepehr / Jagersand, Martin et al. | IEEE | 2017


    Residual Pyramid Learning for Single-Shot Semantic Segmentation

    Chen, Xiaoyu / Lou, Xiaotian / Bai, Lianfa et al. | IEEE | 2020


    ERFNet: Efficient Residual Factorized ConvNet for Real-Time Semantic Segmentation

    Romera, Eduardo / Alvarez, Jose M. / Bergasa, Luis M. et al. | IEEE | 2018


    Impacts of Data Anonymization on Semantic Segmentation

    Zhou, Jingxing / Beyerer, Jurgen | IEEE | 2022


    Sensor validation using semantic segmentation information

    KROEGER TILL | European Patent Office | 2022

    Free access