In the field of autonomous driving, in order to guarantee - robust perception performance at night and to reduce cost of data collection and annotation, there are many day-to-night image translation methods based on Generative Adversarial Networks (GAN) to generate realistic synthetic data. The vehicle light effect is of great significance to the perception task (such as vehicle detection) in the night scene. However, no research has ever focused on the problem of the vehicle light effect in day-to-night image translation. Therefore, we propose an end-to-end day-to-night image translation system based on the local controllable vehicle light effect, which mainly consists of two modules. Module A adopts YOLOv7 for 2.5D vehicle detection and traditional image processing algorithms to obtain the semantic mask of vehicle head/tail lights. Module B adopts a GAN for day-to-night image transformation with the local controllable vehicle light effect. In module B, we propose a Two-Stream UHRNET (TSUH) generator that uses a day image from the source domain, a night image from the target domain and the corresponding vehicle lights semantic mask from module A to generate a photorealistic night image with the same content as the day image and similar style as the night image, and the light effect in the specified vehicle light region in the image. When training our GAN model, considering the large difference in the distribution of vehicle sizes in the image dataset, in order to generate natural and realistic vehicle and light effects in the generated night image, we proposed a vehicle patch loss based on vehicle detection bounding boxes in order to generate natural and realistic vehicle and light effects in the generated night image. The experimental results show that our system can achieve global day-to-night image transformation while performing local vehicle light effect control.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Day-to-Night Image Translation with Local Controllable Vehicle Light Effect for Data Synthesis in Autonomous Driving


    Weitere Titelangaben:

    Sae Technical Papers


    Beteiligte:
    Meng, Chao (Autor:in) / Mei, Jinren (Autor:in) / Gu, Kai (Autor:in) / Zhang, Song (Autor:in) / Wang, Tong (Autor:in) / Shi, Wenxiu (Autor:in)

    Kongress:

    SAE 2023 Intelligent and Connected Vehicles Symposium ; 2023



    Erscheinungsdatum :

    2023-12-20




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Print


    Sprache :

    Englisch




    Night-to-Day: Online Image-to-Image Translation for Object Detection Within Autonomous Driving by Night

    Schutera, Mark / Hussein, Mostafa / Abhau, Jochen et al. | IEEE | 2021


    Night vehicle auxiliary driving system

    XUE YUFEI / WU JINPENG / YUAN QIGANG et al. | Europäisches Patentamt | 2023

    Freier Zugriff

    Night vehicle driving light control method and control system

    LUO TIANHAO / LIU HUIKAI / LIN YANG et al. | Europäisches Patentamt | 2022

    Freier Zugriff

    AUTONOMOUS DRIVING SYSTEM AND AUTONOMOUS DRIVING VEHICLE

    HASHIMOTO RYUTA / WATANABE YOSHINORI / AOKI KENICHIRO et al. | Europäisches Patentamt | 2018

    Freier Zugriff

    KAIST Multi-Spectral Day/Night Data Set for Autonomous and Assisted Driving

    Choi, Yukyung / Kim, Namil / Hwang, Soonmin et al. | IEEE | 2018