Simultaneous localization and mapping (SLAM) are playing an increasingly important role in the field of robotics and autonomous driving. However, when mapping indoor and outdoor large-scale scenes, due to the sparseness of multi-line lidar point clouds, it is difficult to extract features in some scenes, which seriously affects the accuracy and robustness of lidar odometry. Aiming at this problem, this paper proposes an accurate localization algorithm for 3D lidar based on image semantic information constraints. Firstly, the lidar and camera timestamps are synchronized, then the point cloud is projected to the image coordinate system through the transformation matrix; Secondly, the static target semantic information is extracted through the SFSegNets network, and the depth value of the pixels in the area is obtained by interpolation according to the depth information of the point cloud, so as to realize the calculation of the semantic 3D position; Finally, the extracted semantic information of the image is used as landmarks to form constraints with the point clouds at the back end of the lidar odometry for localization optimization. In order to verify the performance of the algorithm proposed in this paper, experimental tests are carried out on the KITTI dataset and the actual campus scene, which both show that loop closures can be effectively detected after adding semantic information constraints. In the KITTI data set experiment with evo evaluation, the absolute error of the odometry has an average improvement of 1.64% after adding image semantic constraints.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    A High-Precision 3D Lidar Odometry Based on Image Semantic Constraints


    Additional title:

    Lect. Notes Electrical Eng.


    Contributors:
    Yang, Changfeng (editor) / Xie, Jun (editor) / Li, Ji (author) / Jiao, Jichao (author) / Li, Ning (author) / Pang, Min (author) / Deng, Zhongliang (author)


    Publication date :

    2022-05-05


    Size :

    10 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    A High-Precision 3D Lidar Odometry Based on Image Semantic Constraints

    Li, Ji / Jiao, Jichao / Li, Ning et al. | TIBKAT | 2022


    Visual Odometry Integrated Semantic Constraints towards Autonomous Driving

    Lan, FengChong / Chen, Jiqing / Yao, Siyu | SAE Technical Papers | 2022


    Visual Odometry Integrated Semantic Constraints towards Autonomous Driving

    Yao, Siyu / Lan, FengChong / Chen, Jiqing | British Library Conference Proceedings | 2022


    DeLiO: Decoupled LiDAR Odometry

    Thomas, Queens Maria / Wasenmuller, Oliver / Stricker, Didier | IEEE | 2019


    Towards Image-Grade LiDAR Odometry and Mapping

    Wang, Yusheng / Song, Weiwei / Lou, Yidong et al. | IEEE | 2022