With information from multiple input modalities, sensor fusion-based algorithms usually out-perform their single-modality counterparts in robotics. Camera and LIDAR, with complementary semantic and depth information, are the typical choices for detection tasks in complicated driving environments. For most camera-LIDAR fusion algorithms, however, the calibration of the sensor suite will greatly impact the performance. More specifically, the detection algorithm usually requires an accurate geometric relationship among multiple sensors as the input, and it is often assumed that the contents from these sensors are captured at the same time. Preparing such sensor suites involves carefully designed calibration rigs and accurate synchronization mechanisms, and the preparation process is usually done offline. In this work, a segmentation-based framework is proposed to jointly estimate the geometrical and temporal parameters in the calibration of a camera-LIDAR suite. A semantic segmentation mask is first applied to both sensor modalities, and the calibration parameters are optimized through pixel-wise bidirectional loss. We specifically incorporated the velocity information from optical flow for temporal parameters. Since supervision is only performed at the segmentation level, no calibration label is needed within the framework. The proposed algorithm is tested on the KITTI dataset, and the result shows an accurate real-time calibration of both geometric and temporal parameters.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    SST-Calib: Simultaneous Spatial-Temporal Parameter Calibration between LIDAR and Camera


    Beteiligte:
    Kodaira, Akio (Autor:in) / Zhou, Yiyang (Autor:in) / Zang, Pengwei (Autor:in) / Zhan, Wei (Autor:in) / Tomizuka, Masayoshi (Autor:in)


    Erscheinungsdatum :

    08.10.2022


    Format / Umfang :

    1334153 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    Temporal and Spatial Online Integrated Calibration for Camera and LiDAR

    Wang, Shouan / Zhang, Xinyu / Zhang, GuiPeng et al. | IEEE | 2022


    Camera-to-LiDAR calibration and validation

    PAUL AUREL DIEDERICHS / MAURILIO DI CICCO / JUN SHERN CHAN et al. | Europäisches Patentamt | 2023

    Freier Zugriff


    Lidar to camera calibration based on edge detection

    WHEELER MARK DAMON / YANG LIN | Europäisches Patentamt | 2020

    Freier Zugriff

    Extrinsic Calibration of a 3D-LIDAR and a Camera

    Mishra, Subodh / Pandey, Gaurav / Saripalli, Srikanth | IEEE | 2020