Visual-inertial Odometry (VIO) provides cars with position information by fusing data from a camera and inertial measurement unit (IMU) which are both widely equipped on intelligent vehicles. Recently, unsupervised VIO has made great progress. However, existing VIOs mainly concatenate features extracted from different domains (visual and inertial), leading to inconsistency during integration. These methods are also difficult to scale to longer sequences because absolute velocity is not available. Hence, we propose a novel network based on attention mechanism to fuse sensors in a self-motivated and meaningful manner. We design spatial and temporal branches that focus on pairwise images and a sequence of images respectively. Meanwhile, a tiny but effective module (referred to as “warm start”) is introduced to produce velocity-related information for the IMU encoder. The proposed attention branches and warm start are shown to improve the robustness of the model in dynamic scenarios and in the case of rapid changes in vehicle velocity. Evaluation on KITTI and Malaga datasets shows that our method outperforms other recent state-of-the-art VO/VIO methods.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    Attention Guided Unsupervised learning of Monocular Visual-inertial Odometry


    Beteiligte:
    Wang, Zhenke (Autor:in) / Zhu, Yuan (Autor:in) / Lu, Ke (Autor:in) / Freer, Daniel (Autor:in) / Wu, Hao (Autor:in) / Chen, Hui (Autor:in)


    Erscheinungsdatum :

    2022-06-05


    Format / Umfang :

    1093951 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Uncertainty-Aware Attention Guided Sensor Fusion For Monocular Visual Inertial Odometry

    Shinde, Kashmira | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2020

    Freier Zugriff

    Unsupervised Monocular Visual Odometry Based on Confidence Evaluation

    Liu, Yiling / Wang, Hesheng / Wang, Jingchuan et al. | IEEE | 2022


    GROUND VEHICLE MONOCULAR VISUAL-INERTIAL ODOMETRY VIA LOCALLY FLAT CONSTRAINTS

    RAMIREZ LLANOS EDUARDO JOSE / YU XIN / VERMA DHIREN | Europäisches Patentamt | 2022

    Freier Zugriff

    VIDO: A Robust and Consistent Monocular Visual-Inertial-Depth Odometry

    Gao, Yuanxi / Yuan, Jing / Jiang, Jingqi et al. | IEEE | 2023


    Ground Vehicle Monocular Visual Odometry

    Sabry, Mohamed / Al-Kaff, Abdulla / Hussein, Ahmed et al. | IEEE | 2019