Convolutional neural networks are the state of the art methods for semantic segmentation but their resource consumption hinders their usability for real-time mobile robotics applications. Recent works have focused on designing lightweight networks that require less resources, but their efficiency is accompanied with a drop in performance. In this work, we propose a pixel-wise weighting of the cross-entropy loss with the disparity map in order to give more importance to close objects during the optimisation procedure of the network. This weighting is applied to two lightweight networks, with different efficiency/performance trade-offs, that were designed for real-time autonomous driving. These networks are trained on CamVid and Cityscapes datasets and the disparity maps are obtained with an off-the-shelf unsupervised depth estimation network. Our method does not increase the number of parameters of the network nor imply any further manual labeling. This weighting is evaluated on both the regular mean intersection over union (mIoU) and a close-range mIoU. Compared to the standard weighting scheme, this new loss weighting improves the mIoU and the IoU of pertinent classes for autonomous driving especially at close range.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Disparity weighted loss for semantic segmentation of driving scenes


    Contributors:


    Publication date :

    2019-10-01


    Size :

    1305188 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    When Visual Disparity Generation Meets Semantic Segmentation: A Mutual Encouragement Approach

    Zhang, Xiaohong / Chen, Yi / Zhang, Haofeng et al. | IEEE | 2021



    Parallel Complement Network for Real-Time Semantic Segmentation of Road Scenes

    Lv, Qingxuan / Sun, Xin / Chen, Changrui et al. | IEEE | 2022


    Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

    Dong, Genshun / Yan, Yan / Shen, Chunhua et al. | IEEE | 2021