It is inevitable to recognize objects in adverse weather conditions where the uncertainty of contour areas is increased. Although some multi-task learning frameworks have gained from the directional supervision between boundary detection and semantic segmentation, the interaction between those two tasks is poorly investigated. Moreover, the performance of the contour detection is expected to degrade under foggy scenarios, because the auxiliary task also has no benefits from the main task. To address the potential risk in intelligent transportation systems, this paper proposes a mutual learning framework, named CE-MGN (Confidence-Enhanced Mutual Graph Network), to propagate confidence through continuous interaction between different tasks rather than only focusing on the accuracy of the main task. The CE-MGN performs an end-to-end training paradigm and jointly learns two tasks, contour detection and semantic segmentation, through pairwise confidence-enhancement mechanism. Moreover, the task interaction is converted into graph space to further relieve the information loss during the feature aggregation in Euclidean space. Such a framework is capable to improve the robustness of respective tasks because of the encouragement from its peer task. Extensive experiments show that our CE-MGN achieved mean IoU scores of 79.35% and 79.03% on CityScapes and Foggy CityScapes datasets, respectively. Besides, our models have a stable performance on different weather severity, where the performance fluctuation is less than 1%.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Confidence-Enhanced Mutual Knowledge for Uncertain Segmentation


    Beteiligte:
    Jiang, Ping (Autor:in) / Deng, Xiaoheng (Autor:in) / Wan, Shaohua (Autor:in) / Qi, Huamei (Autor:in) / Zhang, Shichao (Autor:in)


    Erscheinungsdatum :

    01.01.2024


    Format / Umfang :

    4075898 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Shape-Based Mutual Segmentation

    Riklin-Raviv, T. / Sochen, N. / Kiryati, N. | British Library Online Contents | 2008


    Confidence shape metric for image segmentation

    Zou, Q. / Luo, S. / Zhong, J. et al. | British Library Online Contents | 2013


    Confidence Calibration for Object Detection and Segmentation

    Küppers, Fabian / Haselhoff, Anselm / Kronenberger, Jan et al. | Springer Verlag | 2022

    Freier Zugriff

    Local Mutual Information for Dissimilarity-Based Image Segmentation

    Gueguen, L. | British Library Online Contents | 2014


    Biologically-inspired robust motion segmentation using mutual information

    Ellis, A. L. / Ferryman, J. | British Library Online Contents | 2014