Self-supervised visual odometry (VO) has exhibited remarkable benefits over supervised methods, surpassing the reliance on the annotated ground-truth of training data. However, most existing self-supervised VO methods, namely scene appearance-based methods, have limitations in exploiting the complementary properties of cross-modal information between scene appearance and structure. To this end, we propose a novel self-supervised VO based on scene appearance-structure incremental fusion scheme. Specifically, a Global-Local Context awareness-based Depth estimation Network (GLC-DN) is designed to introduce the scene structural cues, thus laying the foundation for realizing the scene appearance-structure incremental fusion. Then, a Dual stream Pose estimation Network based on Scene Appearance-Structure Incremental Fusion (SASIF-DPN) is devised, which consists of a Dual Stream Network (DSN) and multiple Cross-Modal Complementary Fusion Modules (CM-CFMs). CM-CFM fully leverages the complementary properties between the RGB information and the predicted depth information, and the combination of multiple CM-CFMs facilitates the information interaction between the two modalities in an incremental fusion manner. Detailed evaluations of GLC-DN and SASIF-DPN provably confirm the effectiveness and design principles of each component we propose. Extensive comparison experiments have also been conducted, which clearly verify the superiority of our method compared to current counterparts.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Self-Supervised Visual Odometry Based on Scene Appearance-Structure Incremental Fusion


    Contributors:
    Fu, Fuji (author) / Yang, Jinfu (author) / Ma, Jiaqi (author) / Zhang, Jiahui (author)


    Publication date :

    2025-06-01


    Size :

    2891021 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Self-Supervised Deep Visual Odometry Based on Geometric Attention Model

    Dai, Jiajia / Gong, Xiaoxi / Li, Yida et al. | IEEE | 2023


    Scene Structure Classification as Preprocessing for Feature-Based Visual Odometry

    Aladem, Mohamed / Rawashdeh, Nathir A. / Rawashdeh, Samir A. et al. | SAE Technical Papers | 2018


    Self-supervised 3D keypoint learning for monocular visual odometry

    TANG JIEXIONG / AMBRUS RARES A / GUIZILINI VITOR et al. | European Patent Office | 2024

    Free access

    SELF-SUPERVISED 3D KEYPOINT LEARNING FOR MONOCULAR VISUAL ODOMETRY

    TANG JIEXIONG / AMBRUS RARES A / GUIZILINI VITOR et al. | European Patent Office | 2021

    Free access