To solve the intelligent vehicles’ problems of ‘where am I?’ and ‘what is around me?’, a dense 3D sematic Simultaneous Localization and Mapping (SLAM) system is proposed to evaluate the pose of the intelligent vehicles and build the dense 3D semantic map. We address these challenges by combining a state of art Stereo-ORB-SLAM system and Convolutional Neural Networks. Firstly, we build a dense 3D point cloud map by using a four thread Stereo-ORB-SLAM system. Subsequently, a fully convolutional neural network architecture which uses RGB-D image as input is used to obtain pixel-wise segmentation. Finally, we fuse the geometric information and semantic information to get the semantic map. We test our method on the KITTI dataset and our dataset made with the Fpgalena stereo camera. Results indicate the system was effective in the real-time building of a semantic map, the speed of the entire system is about 10Hz, and the loop closing function can eliminate most of the drifting errors.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Dense 3D Semantic SLAM of traffic environment based on stereo vision


    Contributors:
    Li, Linhui (author) / Liu, Zhijie (author) / Ozginer, Umit (author) / Lian, Jing (author) / Zhou, Yafu (author) / Zhao, Yibing (author)


    Publication date :

    2018-06-01


    Size :

    2900358 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Vision-Based SLAM: Stereo and Monocular Approaches

    Lemaire, T. / Berger, C. / Jung, I. K. et al. | British Library Online Contents | 2007


    Stereo vision SLAM based indoor autonomous mobile robot navigation

    Al-Mutib, Khalid N. / Mattar, Ebrahim A. / Alsulaiman, Mansour M. et al. | IEEE | 2014


    Robust outdoor stereo vision SLAM for heavy machine rotation sensing

    Lin, L. H. | British Library Online Contents | 2013


    Robust and precise 3D-modeling of traffic scenes based on dense stereo vision

    Pfeiffer, David / Barth, Alexander / Franke, Uwe | Tema Archive | 2009