Deep neural networks have been shown to be effective for unsupervised monocular visual odometry that can predict the camera’s ego-motion based on an input of monocular video sequence. However, most existing unsupervised monocular methods haven’t fully exploited the extracted information from both local geometric structure and visual appearance of the scenes, resulting in degraded performance. In this paper, a novel geometry-aware network is proposed to predict the camera’s ego-motion by learning representations in both 2D and 3D space. First, to extract geometry-aware features, we design an RGB-PointCloud feature fusion module to capture information from both geometric structure and the visual appearance of the scenes by fusing local geometric features from depth-map-derived point clouds and visual features from RGB images. Furthermore, the fusion module can adaptively allocate different weights to the two types of features to emphasize important regions. Then, we devise a relevant feature filtering module to build consistency between the two views and preserve informative features with high relevance. It can capture the correlation of frame pairs in the feature-embedding space by attention mechanisms. Finally, the obtained features are fed into the pose estimator to recover the 6-DoF poses of the camera. Extensive experiments show that our method achieves promising results among the unsupervised monocular deep learning methods on the KITTI odometry and TUM-RGBD datasets.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Geometry-Aware Network for Unsupervised Learning of Monocular Camera’s Ego-Motion


    Contributors:
    Zhou, Beibei (author) / Xie, Jin (author) / Jin, Zhong (author) / Kong, Hui (author)

    Published in:

    Publication date :

    2023-12-01


    Size :

    4147492 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Nieuwe generatie IR-camera's

    British Library Online Contents | 1995


    Deepskyfotografie met lowbudget-camera's

    Baart, Ron | Online Contents | 2009


    Intelligente camera's maken processen inzichtelijk

    NS N.V. Nederlandse Spoorwegen Postfach P.O. Box 2025 NL - 3500 HA Utrecht | IuD Bahn | 2003


    Attention Guided Unsupervised learning of Monocular Visual-inertial Odometry

    Wang, Zhenke / Zhu, Yuan / Lu, Ke et al. | IEEE | 2022


    Semiautomatic zoom lens calibration based on the camera's rotation

    Oh, J. / Sohn, K. | British Library Online Contents | 2011