Semantic segmentation in urban scenes is widely used in applications of intelligent transportation systems (ITS). In urban scenes, thermal infrared (TIR) images can be captured in weak illumination conditions or in the presence of obscuration (e.g., light fog, smoke). Therefore, TIR images have great potential to endow automated intelligent vehicles or assist navigation systems. However, TIR imaging is blurry and low-contrast due to the absorption by atmospheric gases and heat transfer effect. Hence, TIR semantic segmentation in urban scenes has rarely been explored even though it has a wide range of scenarios in ITS. To overcome this limitation, we analyze the light transport of TIR light. Our analysis reveals that contours are the reliable features shared by TIR and Visible Spectrum (VS) light. Inspired by this, we attempt to transfer joint features from VS domain to TIR domain. Thus, we propose a curriculum domain adaptation method to guide the TIR urban scene semantic segmentation task from VS domain through contours. Moreover, to evaluate the proposed model, we build TIR-SS: an open-for-request dataset consisting of TIR images and pixel level annotations of 8 classes in urban scenes. Qualitative and quantitative experimental results on the dataset indicate that the proposed domain adaptation method outperforms related methods on this TIR semantic segmentation task.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Light Transport Induced Domain Adaptation for Semantic Segmentation in Thermal Infrared Urban Scenes


    Beteiligte:
    Chen, Junzhang (Autor:in) / Liu, Zichao (Autor:in) / Jin, Darui (Autor:in) / Wang, Yuanyuan (Autor:in) / Yang, Fan (Autor:in) / Bai, Xiangzhi (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    2022-12-01


    Format / Umfang :

    4730875 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

    Dong, Genshun / Yan, Yan / Shen, Chunhua et al. | IEEE | 2021


    CNN based semantic segmentation for urban traffic scenes using fisheye camera

    Deng, Liuyuan / Yang, Ming / Qian, Yeqiang et al. | IEEE | 2017


    A Simple Weight Recall for Semantic Segmentation: Application to Urban Scenes

    LI, Xuhong / DAVOINE, Franck / GRANDVALET, Yves | IEEE | 2018


    Confidence-and-Refinement Adaptation Model for Cross-Domain Semantic Segmentation

    Zhang, Xiaohong / Chen, Yi / Shen, Ziyi et al. | IEEE | 2022