Map inpainting is an important technology in the production of maps for autonomous driving vehicles. In recent years, scholars have often used methods such as point cloud inpainting, RGB image inpainting, and depth inpainting to repair maps. However, these methods require high computational power and result in longer algorithmic processing times. To address this issue, we propose SynerFill, a synergistic RGB-D images inpainting method that can simultaneously inpaint RGB and depth images. We design its network architecture and loss functions, which include a generator, an RGB image discriminator, a depth image discriminator, and an edge image discriminator. Second, we collect real-world data and build a large-scale, multi-scene, multi-weather dataset called the Synthetic City RGB-D (SCRGB-D) Dataset based on 3ds Max, CARLA, and Unreal Engine 4. To verify SynerFill, we conduct experiments on the SCRGB-D dataset, DynaFill dataset, and SceneNet dataset. The experimental results show that SynerFill achieves state-of-the-art (SOTA) performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    SynerFill: A Synergistic RGB-D Image Inpainting Network via Fast Fourier Convolutions


    Contributors:
    Liu, Kunhua (author) / Zhang, Yunqing (author) / Xie, Yuting (author) / Li, Leixin (author) / Wang, Yutong (author) / Chen, Long (author)

    Published in:

    Publication date :

    2024-01-01


    Size :

    2761529 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Blind Co-Channel Interference Cancellation Using Fast Fourier Convolutions

    Naseri, Mostafa / de Poorter, Eli / Moerman, Ingrid et al. | IEEE | 2024


    Fast Image Inpainting Based on Coherence Transport

    Bornemann, F. | British Library Online Contents | 2007


    Fast DFT Algorithm Using Subgroup Convolutions

    Zhang, Yanzhong | Springer Verlag | 2021


    Image Inpainting under Single Image

    Ma, Wenjuan / Hu, Maolin / Hu, Pengyong | IEEE | 2008


    Fast Orientation-Driven Multi-Structure Morphological Inpainting

    Deva, Jemi Florinabel / Selwyn, Ebenezer Juliet / Velayuthum, Sadasivam | British Library Online Contents | 2012