Autonomous mobile vehicles are expected to perform persistent and accurate localization with low-cost equipment. To achieve this goal, we propose a stereo camera based visual localization method using a modified laser map, which takes the advantage of both the low cost of camera, and high geometric precision of laser data to achieve long-term performance. Considering that LiDAR and camera give measurements of the same environment in different modalities, the cross-modal invariance is investigated to modify the laser map for visual localization. Specifically, a map learning algorithm is introduced to sample the robust subsets in laser maps that are useful for visual localization using multi-session visual and laser data. Further, a generative map model is derived to describe this cross-modal invariance, based on which two types of measurements are defined to model the laser map points as appropriate visual observations. Tightly coupling these measurements within the local bundle adjustment during online sliding-window based visual odometry, the vehicle can achieve robust localization even one year after the map was built. The effectiveness of the proposed method is evaluated on both the public KITTI datasets and self-collected datasets in our campus, which include seasonal, illumination and object variations. On all experimental localization sessions, our method provides satisfactory results, even when the direction is opposite to that in the mapping session, verifying the superior performance of the laser map based visual localization method.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Persistent Stereo Visual Localization on Cross-Modal Invariant Map


    Contributors:
    Ding, Xiaqing (author) / Wang, Yue (author) / Xiong, Rong (author) / Li, Dongxuan (author) / Tang, Li (author) / Yin, Huan (author) / Zhao, Liang (author)


    Publication date :

    2020-11-01


    Size :

    4737421 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Stereo Visual Odometry for Indoor Localization of Ship Model

    Kučić, Mario / Valčić, Marko | BASE | 2020

    Free access

    Linear Time Illumination Invariant Stereo Matching

    Xu, J. / Yang, Q. / Tang, J. et al. | British Library Online Contents | 2016


    BRDF invariant stereo using light transport constancy

    Davis, J.E. / Ruigang Yang, / Liang Wang, | IEEE | 2005


    BRDF Invariant Stereo Using Light Transport Constancy

    Davis, J. / Yang, R. / Wang, L. et al. | British Library Conference Proceedings | 2005


    Metric Localization with Scale-Invariant Visual Features Using a Single Perspective Camera

    Bennewitz, Maren / Stachniss, Cyrill / Burgard, Wolfram et al. | Springer Verlag | 2006