Semantic segmentation in urban scenes is widely used in applications of intelligent transportation systems (ITS). In urban scenes, thermal infrared (TIR) images can be captured in weak illumination conditions or in the presence of obscuration (e.g., light fog, smoke). Therefore, TIR images have great potential to endow automated intelligent vehicles or assist navigation systems. However, TIR imaging is blurry and low-contrast due to the absorption by atmospheric gases and heat transfer effect. Hence, TIR semantic segmentation in urban scenes has rarely been explored even though it has a wide range of scenarios in ITS. To overcome this limitation, we analyze the light transport of TIR light. Our analysis reveals that contours are the reliable features shared by TIR and Visible Spectrum (VS) light. Inspired by this, we attempt to transfer joint features from VS domain to TIR domain. Thus, we propose a curriculum domain adaptation method to guide the TIR urban scene semantic segmentation task from VS domain through contours. Moreover, to evaluate the proposed model, we build TIR-SS: an open-for-request dataset consisting of TIR images and pixel level annotations of 8 classes in urban scenes. Qualitative and quantitative experimental results on the dataset indicate that the proposed domain adaptation method outperforms related methods on this TIR semantic segmentation task.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Light Transport Induced Domain Adaptation for Semantic Segmentation in Thermal Infrared Urban Scenes


    Contributors:
    Chen, Junzhang (author) / Liu, Zichao (author) / Jin, Darui (author) / Wang, Yuanyuan (author) / Yang, Fan (author) / Bai, Xiangzhi (author)

    Published in:

    Publication date :

    2022-12-01


    Size :

    4730875 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English




    Domain-Incremental Semantic Segmentation for Traffic Scenes

    Liu, Yazhou / Chen, Haoqi / Lasang, Pongsak et al. | IEEE | 2025


    Real-Time High-Performance Semantic Image Segmentation of Urban Street Scenes

    Dong, Genshun / Yan, Yan / Shen, Chunhua et al. | IEEE | 2021


    CNN based semantic segmentation for urban traffic scenes using fisheye camera

    Deng, Liuyuan / Yang, Ming / Qian, Yeqiang et al. | IEEE | 2017


    A Simple Weight Recall for Semantic Segmentation: Application to Urban Scenes

    LI, Xuhong / DAVOINE, Franck / GRANDVALET, Yves | IEEE | 2018