A method for learning depth-aware keypoints and associated descriptors from monocular video for monocular visual odometry is described. The method includes training a keypoint network and a depth network to learn depth-aware keypoints and the associated descriptors. The training is based on a target image and a context image from successive images of the monocular video. The method also includes lifting 2D keypoints from the target image to learn 3D keypoints based on a learned depth map from the depth network. The method further includes estimating a trajectory of an ego-vehicle based on the learned 3D keypoints.


    Access

    Download


    Export, share and cite



    Title :

    SELF-SUPERVISED 3D KEYPOINT LEARNING FOR MONOCULAR VISUAL ODOMETRY


    Contributors:

    Publication date :

    2021-08-05


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60W CONJOINT CONTROL OF VEHICLE SUB-UNITS OF DIFFERENT TYPE OR DIFFERENT FUNCTION , Gemeinsame Steuerung oder Regelung von Fahrzeug-Unteraggregaten verschiedenen Typs oder verschiedener Funktion / G06N COMPUTER SYSTEMS BASED ON SPECIFIC COMPUTATIONAL MODELS , Rechnersysteme, basierend auf spezifischen Rechenmodellen / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / G06V



    Ground Vehicle Monocular Visual Odometry

    Sabry, Mohamed / Al-Kaff, Abdulla / Hussein, Ahmed et al. | IEEE | 2019


    Attention Guided Unsupervised learning of Monocular Visual-inertial Odometry

    Wang, Zhenke / Zhu, Yuan / Lu, Ke et al. | IEEE | 2022


    Monocular Outlier Detection for Visual Odometry

    Buczko, Martin / Willert, Volker | IEEE | 2017


    Accurate keyframe selection and keypoint tracking for robust visual odometry

    Fanfani, M. / Bellavia, F. / Colombo, C. | British Library Online Contents | 2016


    Multimodal scale estimation for monocular visual odometry

    Fanani, Nolang / Sturck, Alina / Barnada, Marc et al. | IEEE | 2017