In this paper, we investigate the problem of visual odometry for ground vehicles based on the simultaneous utilization of multispectral cameras. It encompasses a stereo rig composed of an optical (visible) and thermal sensors. The novelty resides in the localization of the cameras as a stereo setup rather than two monocular cameras of different spectrums. To the best of our knowledge, this is the first time such task is attempted. Log-Gabor wavelets at different orientations and scales are used to extract interest points from both images. These are then described using a combination of frequency and spatial information within the local neighborhood. Matches between the pairs of multimodal images are computed using the cosine similarity function based on the descriptors. Pyramidal Lucas–Kanade tracker is also introduced to tackle temporal feature matching within challenging sequences of the data sets. The vehicle egomotion is computed from the triangulated 3-D points corresponding to the matched features. A windowed version of bundle adjustment incorporating Gauss–Newton optimization is utilized for motion estimation. An outlier removal scheme is also included within the framework to deal with outliers. Multispectral data sets were generated and used as test bed. They correspond to real outdoor scenarios captured using our multimodal setup. Finally, detailed results validating the proposed strategy are illustrated.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Multispectral Stereo Odometry


    Contributors:


    Publication date :

    2015-06-01


    Size :

    3550097 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Multispectral Stereo Odometry

    Mouats, Tarek | Online Contents | 2015


    Uncertainty Estimation for Stereo Visual Odometry

    Ross, Derek / De Petrillo, Matteo / Strader, Jared et al. | British Library Conference Proceedings | 2021


    Stereo-inertial Odometry Using Nonlinear Optimization

    Huai, Jianzhu / Toth, Charles K. / Grejner-Brzezinska, Dorota A. | British Library Conference Proceedings | 2015


    Large scale visual odometry using stereo vision

    Hernández-Gutiérrez, Andrés / Nieto, Juan I. / Vidal-Calleja, Teresa A. et al. | BASE | 2009

    Free access

    Robust stereo visual odometry from monocular techniques

    Persson, Mikael / Piccini, Tommaso / Felsberg, Michael et al. | IEEE | 2015