Reliable localization and mapping are the key technologies for autonomous driving. In complex and dynamic traffic scenarios, a single sensor cannot provide sufficient information to achieve reliable and accurate Simultaneous Localization and Mapping (SLAM). Therefore, more and more multi-sensor fusion SLAM works have emerged. However, previous multi-sensor fusion SLAM systems mainly utilize geometric information, but not fully leverage semantic information, which plays a crucial role in understanding complex scenes. This paper proposes a semantic-enhanced LiDAR-Visual-Inertial Odometry system named MSE-LVIO, which utilizes the spatial consistency between image semantic segmentation and point cloud clustering to construct a semantic map integrating object attributes, dynamic, and static information. By fully leveraging semantic and object information, real-time dynamic obstacle filtering can be achieved during the front-end registration phase. Our method has been validated in the Carla simulation environment, KITTI raw dataset, and M2DGR dataset. The results show that our approach performs better in dynamic scenes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    MSE-LVIO: Multi-Modal Semantic-Enhanced LiDAR-Visual-Inertial Odometry in Dynamic Traffic Scenes


    Contributors:
    Wang, Dan (author) / Zhu, Ziyu (author) / Hai, Renwei (author) / Shen, Yanqing (author) / Xin, Jingmin (author) / Zheng, Nanning (author)


    Publication date :

    2024-09-24


    Size :

    2009758 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English




    Unified multi-modal landmark tracking for tightly coupled lidar-visual-inertial odometry

    Wisth, D / Camurri, M / Das, S et al. | BASE | 2022

    Free access

    Stereo based visual odometry in difficult traffic scenes

    Golban, Catalin / Istvan, Szakats / Nedevschi, Sergiu | IEEE | 2012


    Stereo Based Visual Odometry in Difficult Traffic Scenes

    Golban, C. / Szakats, I. / Nedevschi, S. et al. | British Library Conference Proceedings | 2012