Deep networks have been used for semantic segmentation tasks on scenes of outdoor environments with increasing popularity. However, the majority of existing work centers on daytime scenes with favorable illumination and weather conditions, and relies on supervision with pixel-level annotations. This paper seeks to address the problem of semantic segmentation for rainy, night-time scenes without using pixel-level annotations. We introduce a near scene semantic approach that uses images of daytime scenes as a bridge for transferring knowledge from pre-trained segmentation models to rainy night images. Specifically, we first present near scene oriented Representation Adaptation (RA) to reduce the domain shift on the representation level. Next, we adapt the segmentation model from the daytime scenario, under varying weather conditions, to the rainy night scenario by using near scene oriented Segmentation Space Adaptation (SSA). Consequently, this further reduces the impact of the domain shift on the segmentation space level. For evaluation, we created a new dataset containing 7000 distinct daytime–night-time image pairs of near scenes obtained by a webcam, and 5266 daytime–rainy night image pairs collected by a car-mounted camera. In addition, we carefully annotated 226 rainy night images with classes defined in Cityscapes. The experimental results clearly demonstrate the advantage of the proposed algorithm.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Rainy Night Scene Understanding With Near Scene Semantic Adaptation


    Beteiligte:
    Di, Shuai (Autor:in) / Feng, Qi (Autor:in) / Li, Chun-Guang (Autor:in) / Zhang, Mei (Autor:in) / Zhang, Honggang (Autor:in) / Elezovikj, Semir (Autor:in) / Tan, Chiu C. (Autor:in) / Ling, Haibin (Autor:in)


    Erscheinungsdatum :

    2021-03-01


    Format / Umfang :

    3543822 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Indoor Scene Understanding with Geometric and Semantic Contexts

    Choi, W. / Chao, Y. W. / Pantofaru, C. et al. | British Library Online Contents | 2015



    Understanding road scene situation and semantic representation of road scene situation for reliable sharing

    YALLA VEERAGANESH / PARUNDEKAR RAHUL RAVI / PILLAI PREETI J et al. | Europäisches Patentamt | 2017

    Freier Zugriff

    Understanding Road Scene Situation and Semantic Representation of Road Scene Situation for Reliable Sharing

    YALLA VEERAGANESH / PARUNDEKAR RAHUL RAVI / PILLAI PREETI J et al. | Europäisches Patentamt | 2017

    Freier Zugriff

    Towards Traffic Scene Description: The Semantic Scene Graph

    Zipfl, Maximilian / Zollner, J. Marius | IEEE | 2022