State-of-the-art stixel methods fuse dense stereo and semantic class information, e.g. from a Convolutional Neural Network (CNN), into a compact representation of driveable space, obstacles, and background. However, they do not explicitly differentiate instances within the same class. We investigate several ways to augment single-frame stixels with instance information, which can similarly be extracted by a CNN from the color input. As a result, our novel Instance Stixels method efficiently computes stixels that do account for boundaries of individual objects, and represents individual instances as grouped stixels that express connectivity. Experiments on Cityscapes demonstrate that including instance information into the stixel computation itself, rather than as a post-processing step, increases Instance AP performance with approximately the same number of stixels. Qualitative results confirm that segmentation improves, especially for overlapping objects of the same class. Additional tests with ground truth instead of CNN output show that the approach has potential for even larger gains. Our Instance Stixels software is made freely available for non-commercial research purposes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Instance Stixels: Segmenting and Grouping Stixels into Objects


    Contributors:


    Publication date :

    2019-06-01


    Size :

    3492318 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Fast and Compact Image Segmentation Using Instance Stixels

    Hehn, Thomas / Kooij, Julian / Gavrila, Dariu | IEEE | 2022


    Ef_; Cient Representation of Traf_; C Scenes by Means of Dynamic Stixels, pp. 217-224

    Pfeiffer, D. / Franke, U. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2010


    Grouping of moving objects

    TOKUNAGA ASUKA / HOSOKAWA SATOSHI / WATANABE SHOICHIRO et al. | European Patent Office | 2020

    Free access

    GROUPING OF MOVING OBJECTS

    TOKUNAGA ASUKA / HOSOKAWA SATOSHI / WATANABE SHOICHIRO et al. | European Patent Office | 2019

    Free access

    Grouping of moving objects

    TOKUNAGA ASUKA / HOSOKAWA SATOSHI / WATANABE SHOICHIRO et al. | European Patent Office | 2021

    Free access