Semantic segmentation and depth estimation play important roles in the field of autonomous driving. In recent years, the advantages of Convolutional Neural Networks (CNNs) have allowed these two topics to flourish. However, people always solve these two tasks separately and rarely solve them in a united model. In this paper, we propose a Mutual Encouragement Network (MENet), which includes a semantic segmentation branch and a disparity regression branch, and simultaneously generates semantic map and visual disparity. In the cost volume construction phase, the depth information is embedded in the semantic segmentation branch to increase contextual understanding. Similarly, the semantic information is also included in the disparity regression branch to generate more accurate disparity. Two branches mutually promote each other during training phase and inference phase. We conducted our method on the popular dataset KITTI, and the experimental results show that our method can outperform the state-of-the-art methods on both visual disparity generation and semantic segmentation. In addition, extensive ablation studies also demonstrate that the two tasks in our method can facilitate each other significantly with the proposed approach.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    When Visual Disparity Generation Meets Semantic Segmentation: A Mutual Encouragement Approach


    Beteiligte:
    Zhang, Xiaohong (Autor:in) / Chen, Yi (Autor:in) / Zhang, Haofeng (Autor:in) / Wang, Shuihua (Autor:in) / Lu, Jianfeng (Autor:in) / Yang, Jingyu (Autor:in)


    Erscheinungsdatum :

    2021-03-01


    Format / Umfang :

    6569735 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Disparity weighted loss for semantic segmentation of driving scenes

    Loukkal, Abdelhak / Grandvalet, Yves / Li, You | IEEE | 2019


    When wheel meets rail

    Tuzik, Robert E. | IuD Bahn | 2000


    When multiplicity meets productivity

    Weart, Walter | IuD Bahn | 2013


    When Discrete Meets Differential

    Lin, W. Y. / Tan, G. C. / Cheong, L. F. | British Library Online Contents | 2010