Camera relocalization is promising for robot navigation; however, the lack of sufficient reference images and challenging shifts of conditions limit its further application. This paper proposes a learning-based three-step pipeline that applies spatial information features for camera relocalization problems. We first introduce a frustum intersection over union (IoU) to represent the image pair's spatial similarity. This representation is used to train an image retrieval model to find nearest neighbor candidates for query images. A spatial sample consensus (SPASAC) operation is then deployed to filter the outliers in the candidates. Afterward, a relative camera pose regressor is used with the valid candidates to predict every query image's absolute pose. Besides, we introduce two implementations of image-to-image translation networks for camera relocalization to increase the number of synthetic reference images and challenging night-to-day localization performance. Experiments show that our method can estimate camera poses across different domains and outperforms related methods in four benchmarks. Specifically, the experiments on the Tuebingen Buildings dataset demonstrate the robustness of our approach when localizing UAV-captured images with highspeed movement and large viewpoint variation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Learning-based Camera Relocalization with Domain Adaptation via Image-to-Image Translation


    Contributors:
    Yang, Chenhao (author) / Liu, Yuyi (author) / Zell, Andreas (author)


    Publication date :

    2021-06-15


    Size :

    5172187 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Federated learning based multi-domain image-to-image translation

    Ge, Yingjun / Wang, Xiaodong / Zhou, Jiting | British Library Conference Proceedings | 2022


    Lane markings-based relocalization on highway

    Revilloud, Marc / Doucet, Emmanuel | IEEE | 2019


    Camera peripheral image output system with camera image adjustment

    PARK HYUN JU | European Patent Office | 2019

    Free access

    Cross-modal domain adaptation for text-based regularization of image semantics in image retrieval systems

    Costa Pereira, J. / Vasconcelos, N. | British Library Online Contents | 2014


    DOMAIN ADAPTATION FOR IMAGE CLASSIFICATION USING CLASS PRIOR PROBABILITY

    BORIS CHIDLOVSKI / GABRIELA CSURKA | European Patent Office | 2016

    Free access