The rapid development of autonomous driving in recent years presents many challenges for scene understanding. As an essential step towards scene understanding, semantic segmentation has received increased attention in the past few years. Although deep learning based approaches have achieved great success in improving the segmentation accuracy, most of them suffer from an inefficiency problem and can hardly be applied to real-time applications. In this paper, we analyze the computational cost of Convolutional Neural Network (CNN) and find that the inefficiency of CNNs is mainly caused by their wide structure rather than deep structure. In addition, the success of pruning based model compression methods proves that there are many redundant channels in CNNs. Thus, we design a narrow while deep backbone network to improve the efficiency of semantic segmentation. By casting our network to fully convolutional network (FCN32) segmentation architecture, the basic structure of most segmentation methods, we achieve 61.5% mIoU on Cityscapes validation dataset with only 4.2G floating-point operations (FLOPs) on $1024\times 2048$ inputs, which already outperforms one of the earliest real-time deep learning based segmentation methods: ENet (58.3% mIoU, 3.8G FLOPs on $640\times 360$ inputs). By further refining the output resolution of our network to the 1/8 of the input resolution with a simple encoder-decoder structure, we achieve 65.3% mIoU on Cityscapes test set with 14.0G FLOPs and 39.9 frames per second (FPS) on Titan X card. We have made our model publicly available at https://github.com/zgyang-hnu/NDNet.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    NDNet: Narrow While Deep Network for Real-Time Semantic Segmentation


    Beteiligte:
    Yang, Zhengeng (Autor:in) / Yu, Hongshan (Autor:in) / Fu, Qiang (Autor:in) / Sun, Wei (Autor:in) / Jia, Wenyan (Autor:in) / Sun, Mingui (Autor:in) / Mao, Zhi-Hong (Autor:in)


    Erscheinungsdatum :

    2021-09-01


    Format / Umfang :

    3392944 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Real-time Semantic Segmentation-based Depth Upsampling using Deep Learning

    Miclea, Vlad-Cristian / Nedevschi, Sergiu | IEEE | 2018


    Efficient Neural Network For Real Semantic Segmentation

    Spoorthi, D N / Ashwini, B P | IEEE | 2019


    Parallel Complement Network for Real-Time Semantic Segmentation of Road Scenes

    Lv, Qingxuan / Sun, Xin / Chen, Changrui et al. | IEEE | 2022


    Efficient ConvNet for real-time semantic segmentation

    Romera, Eduardo / Alvarez, Jose M. / Bergasa, Luis M. et al. | IEEE | 2017