Besides the large amount of information multispectral imaging offers, multispectral visual odometry remains overlooked due to the dissimilarity between modalities. In order to tackle the challenging feature matching between multispectral stereo images and to overcome the lack of robust multispectral visual localisation solutions, a novel approach is proposed in this paper. It consists in tracking features in each modality simultaneously, in a monocular manner and then, estimating motion in a windowed bundle adjustment framework and using the geometry of the stereo setup to recover the missing scale. The estimation is robustified by selecting adequate keyframes based on feature parallax and by maximising the mutual information between all the features reprojected in the stereo pair. Furthermore, the proposed multispectral visual odometry solution is integrated in an error-state Kalman filter framework to deal with challenging environments, where the quality of images is reduced. Two measurements models, using absolute and relative camera poses, are presented. The superiority of relative poses is then shown by providing a failure recovery algorithm which relies on inertial data when visual data are not accessible. The algorithm was tested on innovative series of visible-thermal multispectral datasets, acquired from a car with real driving conditions. An overall error of around 2% of the travelled distance was achieved on these datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Robust Multispectral Visual-Inertial Navigation With Visual Odometry Failure Recovery


    Contributors:


    Publication date :

    2022-07-01


    Size :

    2932632 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Communicationless navigation through robust visual odometry

    Van Hamme, David / Veelaert, Peter / Philips, Wilfried | IEEE | 2012


    WHEEL ODOMETRY AIDED VISUAL-INERTIAL ODOMETRY FOR LAND VEHICLE NAVIGATION IN WINTER URBAN ENVIRONMENTS

    Huang, Cheng / Jiang, Yang / O Keefe, Kyle | British Library Conference Proceedings | 2020


    RADAR AIDED VISUAL INERTIAL ODOMETRY INITIALIZATION

    NIESEN URS | European Patent Office | 2019

    Free access

    VIDO: A Robust and Consistent Monocular Visual-Inertial-Depth Odometry

    Gao, Yuanxi / Yuan, Jing / Jiang, Jingqi et al. | IEEE | 2023