In this paper we present CMRNet, a realtime approach based on a Convolutional Neural Network (CNN) to localize an RGB image of a scene in a map built from LiDAR data. Our network is not trained in the working area, i. e., CMRNet does not learn the map. Instead it learns to match an image to the map. We validate our approach on the KITTI dataset, processing each frame independently without any tracking procedure. CMRNet achieves 0.27m and 1.07° median localization accuracy on the sequence 00 of the odometry dataset, starting from a rough pose estimate displaced up to 3.5m and 17°. To the best of our knowledge this is the first CNN-based approach that learns to match images from a monocular camera to a given, preexisting 3D LiDAR-map.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    CMRNet: Camera to LiDAR-Map Registration


    Beteiligte:
    Cattaneo, D. (Autor:in) / Vaghi, M. (Autor:in) / Ballardini, A. L. (Autor:in) / Fontana, S. (Autor:in) / Sorrenti, D. G. (Autor:in) / Burgard, W. (Autor:in)


    Erscheinungsdatum :

    2019-10-01


    Format / Umfang :

    3017103 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    MOTION MONITOR USING LIDAR REGISTRATION

    LONGMAN OREN / ZAC NOAM / FURMAN TAL | Europäisches Patentamt | 2023

    Freier Zugriff

    Points Registration for Roadside LiDAR Sensors

    Wu, Jianqing / Xu, Hao / Liu, Wei | Transportation Research Record | 2019


    LiDAR MERGING LiDAR INFORMATION AND CAMERA INFORMATION

    LEE JONG HO | Europäisches Patentamt | 2022

    Freier Zugriff

    LiDAR MERGING LiDAR INFORMATION AND CAMERA INFORMATION

    LEE JONG HO | Europäisches Patentamt | 2022

    Freier Zugriff