The state of the art in autonomous vehicle technology has been advanced due to progress in multiple disciplines, including multi-modal object detection algorithms. With the falling cost of multi-sensor fusion hardware, namely camera and lidar, combined with state-of-the-art fusion-based detection algorithms, camera-lidar data produce superior perception results. However, fusing camera and lidar data requires known extrinsic calibration parameters to properly combine these modalities, which can change during an autonomous vehicle's operation. In this paper, we taxonomize the leading targetless calibration methods into three categories based on their underlying algorithms, namely feature, information theory, and learning-based methods. To showcase the impact of selecting a specific automatic targetless calibration method, we evaluate the robustness of each specific method in the context of multi-modal object detection. We demonstrate that the effects of miscalibration can cause severe degradations in performance, even with seemingly small changes in calibration parameters. We also find that most recent learning-based camera-lidar calibration methods lead to equivalent or superior 3D object detection performance when compared with state-of-the-art feature and information theory-based calibration methods. To the best of our knowledge, this work represents a first attempt at analyzing the impact of camera-lidar miscalibration on the performance of multi-modal object detection frameworks.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A Taxonomization and Comparative Evaluation of Targetless Camera-Lidar Calibration for Autonomous Vehicles


    Beteiligte:
    Guo, Xinwei (Autor:in) / Kent, Daniel (Autor:in) / Lu, Xiaohu (Autor:in) / Radha, Hayder (Autor:in)


    Erscheinungsdatum :

    24.09.2024


    Format / Umfang :

    2149908 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch




    Targetless vehicular camera calibration system

    OKOUNEVA GALINA | Europäisches Patentamt | 2024

    Freier Zugriff

    TARGETLESS VEHICLE CAMERA CALIBRATION SYSTEM

    SINGH JAGMAL / PLIEFKE SEBASTIAN / HESS HOLGER | Europäisches Patentamt | 2017

    Freier Zugriff

    Targetless vehicular camera calibration system

    OKOUNEVA GALINA | Europäisches Patentamt | 2023

    Freier Zugriff

    Targetless vehicular camera calibration method

    OKOUNEVA GALINA | Europäisches Patentamt | 2020

    Freier Zugriff