State-of-the-art stixel methods fuse dense stereo disparity and semantic class information, e.g., from a Convolutional Neural Network (CNN), into a compact representation of driveable space, obstacles and background. However, they do not explicitly differentiate instances within the same semantic class. We investigate several ways to augment single-frame stixels with instance information, which can be extracted by a CNN from the RGB image input. As a result, our novel Instance Stixels method efficiently computes stixels that account for boundaries of individual objects, and represents instances as grouped stixels that express connectivity. Experiments on the Cityscapes dataset demonstrate that including instance information into the stixel computation itself, rather than as a post-processing step, increases the segmentation performance (i.e., Intersection over Union and Average Precision). This holds especially for overlapping objects of the same class. Furthermore, we show the superiority of our approach in terms of segmentation performance and computational efficiency compared to combining the separate outputs of Semantic Stixels and a state-of-the-art pixel-level CNN. We achieve processing throughput of 28 frames per second on average for 8 pixel wide stixels on images from the Cityscapes dataset at 1792 × 784 pixels. Our Instance Stixels software is made freely available for non-commercial research purposes.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Fast and Compact Image Segmentation Using Instance Stixels


    Beteiligte:
    Hehn, Thomas (Autor:in) / Kooij, Julian (Autor:in) / Gavrila, Dariu (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-03-01


    Format / Umfang :

    5009073 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Instance Stixels: Segmenting and Grouping Stixels into Objects

    Hehn, Thomas M. / Kooij, Julian F. P. / Gavrila, Dariu M. | IEEE | 2019


    Instance Segmentation as Image Segmentation Annotation

    Watanabe, Thomio / Wolf, Denis F. | IEEE | 2019


    Ef_; Cient Representation of Traf_; C Scenes by Means of Dynamic Stixels, pp. 217-224

    Pfeiffer, D. / Franke, U. / Institute of Electrical and Electronics Engineers | British Library Conference Proceedings | 2010


    Instance segmentation imaging system

    PHILION JONAH / ZHAO YIBIAO | Europäisches Patentamt | 2023

    Freier Zugriff

    Instance segmentation imaging system

    PHILION JONAH / ZHAO YIBIAO | Europäisches Patentamt | 2023

    Freier Zugriff