Street scene understanding is an essential task for autonomous driving. One important step toward this direction is scene labeling, which annotates each pixel in the images with a correct class label. Although many approaches have been developed, there are still some weak points. First, many methods are based on the hand-crafted features whose image representation ability is limited. Second, they cannot label foreground objects accurately due to the data set bias. Third, in the refinement stage, the traditional Markov random filed inference is prone to over smoothness. For improving the above problems, this paper proposes a joint method of priori convolutional neural networks at superpixel level (called as “priori s-CNNs”) and soft restricted context transfer. Our contributions are threefold: 1) a priori s-CNNs model that learns priori location information at superpixel level is proposed to describe various objects discriminatingly; 2) a hierarchical data augmentation method is presented to alleviate data set bias in the priori s-CNNs training stage, which improves foreground objects labeling significantly; and 3) a soft restricted MRF energy function is defined to improve the priori s-CNNs model’s labeling performance and reduce the over smoothness at the same time. The proposed approach is verified on CamVid data set (11 classes) and SIFT Flow Street data set (16 classes) and achieves a competitive performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A Joint Convolutional Neural Networks and Context Transfer for Street Scenes Labeling


    Contributors:
    Wang, Qi (author) / Gao, Junyu (author) / Yuan, Yuan (author)


    Publication date :

    2018-05-01


    Size :

    4575853 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Integrating Geometrical Context for Semantic Labeling of Indoor Scenes using RGBD Images

    Khan, S. H. / Bennamoun, M. / Sohel, F. et al. | British Library Online Contents | 2016


    Convolutional Neural Networks for On-Street Parking Space Detection in Urban Networks

    Gkolias, Konstantinos / Vlahogianni, Eleni I. | IEEE | 2019


    Convolutional Neural Networks

    Habibi Aghdam, Hamed / Jahani Heravi, Elnaz | Springer Verlag | 2017


    Semi-automatic image annotation of street scenes

    Petrovai, Andra / Costea, Arthur D. / Nedevschi, Sergiu | IEEE | 2017


    Semi-Automatic Image Annotation of Street Scenes

    Petrovai, Andrà / Costea, Arthur Daniel / Nedevschi, Sergiu | British Library Conference Proceedings | 2017