In the field of autonomous driving, in order to guarantee - robust perception performance at night and to reduce cost of data collection and annotation, there are many day-to-night image translation methods based on Generative Adversarial Networks (GAN) to generate realistic synthetic data. The vehicle light effect is of great significance to the perception task (such as vehicle detection) in the night scene. However, no research has ever focused on the problem of the vehicle light effect in day-to-night image translation. Therefore, we propose an end-to-end day-to-night image translation system based on the local controllable vehicle light effect, which mainly consists of two modules. Module A adopts YOLOv7 for 2.5D vehicle detection and traditional image processing algorithms to obtain the semantic mask of vehicle head/tail lights. Module B adopts a GAN for day-to-night image transformation with the local controllable vehicle light effect. In module B, we propose a Two-Stream UHRNET (TSUH) generator that uses a day image from the source domain, a night image from the target domain and the corresponding vehicle lights semantic mask from module A to generate a photorealistic night image with the same content as the day image and similar style as the night image, and the light effect in the specified vehicle light region in the image. When training our GAN model, considering the large difference in the distribution of vehicle sizes in the image dataset, in order to generate natural and realistic vehicle and light effects in the generated night image, we proposed a vehicle patch loss based on vehicle detection bounding boxes in order to generate natural and realistic vehicle and light effects in the generated night image. The experimental results show that our system can achieve global day-to-night image transformation while performing local vehicle light effect control.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Day-to-Night Image Translation with Local Controllable Vehicle Light Effect for Data Synthesis in Autonomous Driving


    Additional title:

    Sae Technical Papers


    Contributors:
    Meng, Chao (author) / Mei, Jinren (author) / Gu, Kai (author) / Zhang, Song (author) / Wang, Tong (author) / Shi, Wenxiu (author)

    Conference:

    SAE 2023 Intelligent and Connected Vehicles Symposium ; 2023



    Publication date :

    2023-12-20




    Type of media :

    Conference paper


    Type of material :

    Print


    Language :

    English




    Night-to-Day: Online Image-to-Image Translation for Object Detection Within Autonomous Driving by Night

    Schutera, Mark / Hussein, Mostafa / Abhau, Jochen et al. | IEEE | 2021


    Night vehicle driving light control method and control system

    LUO TIANHAO / LIU HUIKAI / LIN YANG et al. | European Patent Office | 2022

    Free access

    Night vehicle auxiliary driving system

    XUE YUFEI / WU JINPENG / YUAN QIGANG et al. | European Patent Office | 2023

    Free access

    KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving

    Choi, Yukyung / Kim, Namil / Hwang, Soonmin et al. | IEEE | 2018


    Vehicle night driving emergency lighting device

    LIN JINFENG | European Patent Office | 2021

    Free access