In recent years, considerable progress has been made in semantic segmentation of images with favorable environments. However, the environmental perception of autonomous driving under adverse weather conditions is still very challenging. In particular, the low visibility at nighttime greatly affects driving safety. In this paper, we aim to explore image segmentation in low-light scenarios, thereby expanding the application range of autonomous vehicles. The segmentation algorithms for road scenes based on deep learning are highly dependent on the volume of images with pixel-level annotations. Considering the scarcity of labeled large-scale nighttime data, we performed synthetic data collection and data style transfer using images acquired in daytime based on the autonomous driving simulation platform and generative adversarial network, respectively. In addition, we also proposed a novel nighttime segmentation framework (SFNET-N) to effectively recognize objects in dark environments, aiming at the boundary blurring caused by low semantic contrast in low-illumination images. Specifically, the framework comprises a light enhancement network which introduces semantic information for the first time and a segmentation network with strong feature extraction capability. Extensive experiments with Dark Zurich-test and Nighttime Driving-test datasets show the effectiveness of our method compared with existing state-of-the art approaches, with 56.9% and 57.4% mIoU (mean of category-wise intersection-over-union) respectively. Finally, we also performed real-vehicle verification of the proposed models in road scenes of Zhenjiang city with poor lighting. The datasets are available at https://github.com/pupu-chenyanyan/semantic-segmentation-on-nightime.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SFNet-N: An Improved SFNet Algorithm for Semantic Segmentation of Low-Light Autonomous Driving Road Scenes


    Contributors:
    Wang, Hai (author) / Chen, Yanyan (author) / Cai, Yingfeng (author) / Chen, Long (author) / Li, Yicheng (author) / Sotelo, Miguel Angel (author) / Li, Zhixiong (author)

    Published in:

    Publication date :

    2022-11-01


    Size :

    7057222 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Disparity weighted loss for semantic segmentation of driving scenes

    Loukkal, Abdelhak / Grandvalet, Yves / Li, You | IEEE | 2019


    Semantic Segmentation of Road Profiles for Efficient Sensing in Autonomous Driving

    Cheng, Guo / Zheng, Jiang Yu / Kilicarslan, Mehmet | IEEE | 2019


    Parallel Complement Network for Real-Time Semantic Segmentation of Road Scenes

    Lv, Qingxuan / Sun, Xin / Chen, Changrui et al. | IEEE | 2022


    Attribute-aware Semantic Segmentation of Road Scenes for Understanding Pedestrian Orientations

    Sulistiyo, M. D. / Kawanishi, Y. / Deguchi, D. et al. | IEEE | 2018


    LiSeg: Lightweight Road-object Semantic Segmentation In 3D LiDAR Scans For Autonomous Driving

    Zhang, Wenquan / Zhou, Chancheng / Yang, Junjie et al. | IEEE | 2018