Image based localization is a key block of visual simultaneous localization and mapping (SLAM) system where image data is used to localize the camera relative to an arbitrary reference frame. Although finding the location from one image or between two images is well studied in the literature, few works study the problem of finding the pose of multiple images in videos of different frame lengths. Here, we propose two different architectures to address this problem, one using a combination of 2D convolutional neural network (CNN) and recurrent neural networks (RNN) and the other using 3D CNN. We demonstrate that 3D CNN is better for pose estimation problem than CNN-RNN by visualizing the learned features per layer of both architectures and the accuracy performance. Further, instead of using RGB images as input to the networks, we use SURF descriptors to reduce the image dimension of 480×640×3 by more than 48 folds, making the training time much faster and the learning model less complex. Both architectures show competitive performance in comparison to the state of the art on indoor localization dataset with the ability to generalize to test scenes that are completely different from the training scenes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Generalizable Sequential Camera Pose Learning Using Surf Enhanced 3D CNN


    Contributors:


    Publication date :

    2020-11-01


    Size :

    3454432 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Generalizable Journey Mode Detection Using Unsupervised Representation Learning

    Bandyopadhyay, Soma / Datta, Anish / Ramakrishnan, Ramesh Kumar et al. | IEEE | 2024


    A Size-Generalizable GNN for Learning Precoding

    Guo, Jia / Yang, Chenyang | IEEE | 2023


    Generalizable Aircraft Takeoff Weight Estimation from Trajectory Data using Machine Learning

    Ayzit, Recep / Cengiz, Melih S. / Uzun, Mevlut et al. | AIAA | 2023


    Generalizable Deep Learning Module for Rotorcraft Inverse Design Applications

    Anand, Apurva / Marepally, Koushik / Safdar, M Muneeb et al. | AIAA | 2024


    Generalizable Aircraft Takeoff Weight Estimation from Trajectory Data Using Machine Learning

    Ayzit, Recep / Cengiz, Melih S. / Uzun, Mevlut et al. | TIBKAT | 2023