In this paper, we present a novel multi-sensor fusion framework for tightly coupled monocular visual-LiDAR odometry and mapping. Compared to previous visual-LiDAR fusion frameworks, our proposed framework leverages more constraints among LiDAR features and visual features and integrates that in a tightly coupled approach. Specifically, the framework starts with a preprocess module which contains LiDAR feature extraction, visual feature extraction and tracking, and visual feature depth recover. Then a frame-to-frame odometry module is established by fusing visual feature tracking and LiDAR feature match between frames, aiming to provide a coarse pose estimation for next module. Finally, to refine the pose and build a multi-modal map, we introduce a multi-modal mapping module that tightly couple multi-modal feature constraints by matching or registering multi-modal features to multi-modal map. In addition, the proposed fusion framework also functions well in sensor-degraded environment (texture-less or structure-less), which increases its robustness. The effectiveness and performance of the proposed fusion framework are demonstrated and evaluated on the public KITTI odometry benchmark, and results show that our proposed fusion framework achieves comparable performance compared with the state-of-the-art visual-LiDAR odometry frameworks.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multi-Modal Feature Constraint Based Tightly Coupled Monocular Visual-LiDAR Odometry and Mapping


    Contributors:
    Shu, Chengfu (author) / Luo, Yutao (author)

    Published in:

    Publication date :

    2023-05-01


    Size :

    1598067 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Unified multi-modal landmark tracking for tightly coupled lidar-visual-inertial odometry

    Wisth, D / Camurri, M / Das, S et al. | BASE | 2022

    Free access

    Hierarchical Distribution-Based Tightly-Coupled LiDAR Inertial Odometry

    Wang, Chengpeng / Cao, Zhiqiang / Li, Jianjie et al. | IEEE | 2024


    VEHICLE LOCALIZATION WITH TIGHTLY COUPLED GNSS AND VISUAL ODOMETRY

    Schreiber, Markus / Königshof, Hendrik / Hellmund, André-Marcel et al. | British Library Conference Proceedings | 2016


    Vehicle localization with tightly coupled GNSS and visual odometry

    Schreiber, Markus / Konigshof, Hendrik / Hellmund, Andre-Marcel et al. | IEEE | 2016


    Ground Vehicle Monocular Visual Odometry

    Sabry, Mohamed / Al-Kaff, Abdulla / Hussein, Ahmed et al. | IEEE | 2019