While previous neural rendering methods have shown promising results in novel view synthesis, they still face difficulties when dealing with challenging street scenes. For instance, certain objects or content may only appear in a limited number of views, which can result in blurry synthesized images with significant artifacts. To address this critical issue, we propose a novel point-based neural rendering framework that facilitates a photo-realistic street simulation environment. Specifically, we introduce the Neural Street Scene Renderer (NSSR) to handle holes resulting from sparse point clouds. We also present a parallel attention module (PAM) and a multi-scale feature fusion and selection module (FFSM) to recalibrate features. Additionally, we use a point cloud filter and Gaussian noise points to remove outliers or floating points in the air and repair sparse point clouds. Our experimental results on four datasets demonstrate the effectiveness of our proposed approach in synthesizing photo-realistic street scenes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Point-Based Neural Scene Rendering for Street Views


    Contributors:
    Li, Zhuopeng (author) / Zhu, Jianke (author)

    Published in:

    Publication date :

    2024-01-01


    Size :

    7098450 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Enhancing Scene Simulation for Autonomous Driving with Neural Point Rendering

    Yang, Junqing / Yan, Yuxi / Chen, Shitao et al. | IEEE | 2023


    Mosaic-Based 3D Scene Representation and Rendering

    Zhu, Z. / Hanson, A. R. | British Library Conference Proceedings | 2005


    Views of the Street

    McAndrews, Carolyn / Flórez, Josefina / Deakin, Elizabeth | Transportation Research Record | 2006


    Mosaic-based 3D scene representation and rendering

    Zhigang Zhu, / Hanson, A.R. | IEEE | 2005


    Automatic driving scene data generation method and system based on implicit neural rendering

    YAN GUOXING / PI JIAHAO / SHI BOTIAN et al. | European Patent Office | 2023

    Free access