It is inevitable to recognize objects in adverse weather conditions where the uncertainty of contour areas is increased. Although some multi-task learning frameworks have gained from the directional supervision between boundary detection and semantic segmentation, the interaction between those two tasks is poorly investigated. Moreover, the performance of the contour detection is expected to degrade under foggy scenarios, because the auxiliary task also has no benefits from the main task. To address the potential risk in intelligent transportation systems, this paper proposes a mutual learning framework, named CE-MGN (Confidence-Enhanced Mutual Graph Network), to propagate confidence through continuous interaction between different tasks rather than only focusing on the accuracy of the main task. The CE-MGN performs an end-to-end training paradigm and jointly learns two tasks, contour detection and semantic segmentation, through pairwise confidence-enhancement mechanism. Moreover, the task interaction is converted into graph space to further relieve the information loss during the feature aggregation in Euclidean space. Such a framework is capable to improve the robustness of respective tasks because of the encouragement from its peer task. Extensive experiments show that our CE-MGN achieved mean IoU scores of 79.35% and 79.03% on CityScapes and Foggy CityScapes datasets, respectively. Besides, our models have a stable performance on different weather severity, where the performance fluctuation is less than 1%.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Confidence-Enhanced Mutual Knowledge for Uncertain Segmentation


    Contributors:
    Jiang, Ping (author) / Deng, Xiaoheng (author) / Wan, Shaohua (author) / Qi, Huamei (author) / Zhang, Shichao (author)


    Publication date :

    2024-01-01


    Size :

    4075898 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Shape-Based Mutual Segmentation

    Riklin-Raviv, T. / Sochen, N. / Kiryati, N. | British Library Online Contents | 2008


    Confidence shape metric for image segmentation

    Zou, Q. / Luo, S. / Zhong, J. et al. | British Library Online Contents | 2013


    Biologically-inspired robust motion segmentation using mutual information

    Ellis, A. L. / Ferryman, J. | British Library Online Contents | 2014


    Local Mutual Information for Dissimilarity-Based Image Segmentation

    Gueguen, L. | British Library Online Contents | 2014


    Uncertain Knowledge Gathering: An Evolutionary Approach

    Hooijmaijers, D. / Bright, D. | British Library Conference Proceedings | 2005