3D point-cloud upsampling, a crucial perceptual module to help us understand the complex scene and object, aims to generate a high-resolution point cloud given a sparse point set. While considerable attention has been paid to single object point-cloud upsampling, literature on upsampling complex scenes has emerged slowly. Remarkably, few related works target LiDAR-based point clouds, which inherently have a density imbalance problem over distance. This paper proposed LiUpNet, a LiDAR-based point cloud upsampling network. Given a sparse and imbalanced point cloud of a natural and complex scene, LiUpNet extracts robust regional features and generates a uniformly distributed dense point cloud that preserves the fine-grained structural architecture. Specifically, in LiUpNet, an attentive and transformer-based feature extractor is applied to learn the detailed regional representation to model the underlying complex local structure. Also, a novel density-invariant feature consistency loss is introduced to improve the robustness of the learned features against the sparsity changes. Finally, given the regional representations, we append a manifold-based upsampler to super-resolve the regional point clouds up to different scales according to the sparsity and implicitly regresses non-linear 3D scene surfaces. A more uniformly distributed and denser scene point cloud is then achieved with the scheme of dynamic regional upsampling rates. The experimental results on single-object and scene point-cloud upsampling show that LiUpNet outperforms related works qualitatively and quantitatively. Additionally, we demonstrate that the enhanced scene point clouds can efficiently improve the performance of downstream tasks such as point-cloud-based 3D object detection and depth completion.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Density-Imbalance-Eased LiDAR Point Cloud Upsampling via Feature Consistency Learning


    Contributors:

    Published in:

    Publication date :

    2023-04-01


    Size :

    6628520 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    A320: Maintenance eased

    Online Contents | 1996


    Semantically aware multilateral filter for depth upsampling in automotive LiDAR point clouds

    Dimitrievski, Martin / Veelaert, Peter / Philips, Wilfried | IEEE | 2017


    Radar Beacon Problems Eased

    Klass, P.J. | Tema Archive | 1972


    Qantas ownership caps eased

    Online Contents | 2010