Semantic segmentation (SS) aims to classify each pixel into one of the pre-defined classes. This task plays an important role in self-driving cars and autonomous drones. In SS, many works have shown that most misclassified pixels are commonly near object boundaries with high uncertainties. However, existing SS loss functions are not tailored to handle these uncertain pixels during training, as these pixels are usually treated equally as confidently classified pixels and cannot be embedded with arbitrary low distortion in Euclidean space, thereby degenerating the performance of SS. To overcome this problem, this paper designs a Hyperbolic Uncertainty Loss (HyperUL), which dynamically highlights the misclassified and high-uncertainty pixels in Hyperbolic space during training via the hyperbolic distances. The proposed HyperUL is model agnostic and can be easily applied to various neural architectures. After employing HyperUL to three recent SS models, the experimental results on Cityscapes, UAVid, and ACDC datasets reveal that the segmentation performance of existing SS models can be consistently improved. Additionally, reliable measurement of model uncertainty plays a key role in real-world applications such as autonomous controls of vehicles and drones. To meet this requirement, we propose the Hyperbolic Uncertainty Estimation method, which is easily implemented by only post-processing the generated Hyperbolic embeddings. By this approach, we can calculate the uncertainty values almost for free. Quantitative and qualitative results on Cityscapes, UAVid, and ACDC datasets verify that our proposed uncertainty estimation method usually outputs more meaningful results compared with popular MC-dropout and ensembling methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Hyperbolic Uncertainty Aware Semantic Segmentation


    Beteiligte:
    Chen, Bike (Autor:in) / Peng, Wei (Autor:in) / Cao, Xiaofeng (Autor:in) / Roning, Juha (Autor:in)


    Erscheinungsdatum :

    2024-02-01


    Format / Umfang :

    5536970 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Importance-Aware Semantic Segmentation for Autonomous Vehicles

    Chen, Bike / Gong, Chen / Yang, Jian | IEEE | 2019


    Situation-Aware Model Refinement for Semantic Image Segmentation

    Habermayr, Lukas / Hofbauer, Markus / Zacchi, Joao-Vitor et al. | IEEE | 2021


    Semantic segmentation of infrared ships based on scene-aware priors

    Hu, Junwei / Zhang, Feng / Zhang, Jinsuo et al. | British Library Conference Proceedings | 2023


    Semantic segmentation of infrared ships based on scene-aware priors

    Hu, Junwei / Zhang, Feng / Zhang, Jinsuo et al. | SPIE | 2023


    Attribute-aware Semantic Segmentation of Road Scenes for Understanding Pedestrian Orientations

    Sulistiyo, M. D. / Kawanishi, Y. / Deguchi, D. et al. | IEEE | 2018