A system performs calibration of sensors mounted on a vehicle, for example, lidar and camera sensors mounted on a vehicle, for example, an autonomous vehicle. The system receives a lidar scan and camera image of a view and determines a lidar-to-camera transform based on the lidar scan and the camera image. The system may use a pattern, for example, a checkerboard pattern in the view for calibration. The pattern is placed close to the vehicle to determine an approximate lidar-to-camera transform and then placed at a distance from the vehicle to determine an accurate lidar-to-camera transform. Alternatively, the system determines edges in the lidar scan and the camera image and aligns features based on real-world objects in the scene by comparing edges.


    Access

    Download


    Export, share and cite



    Title :

    Lidar to camera calibration based on edge detection


    Contributors:

    Publication date :

    2020-11-17


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen / B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G01C Messen von Entfernungen, Höhen, Neigungen oder Richtungen , MEASURING DISTANCES, LEVELS OR BEARINGS / G01S RADIO DIRECTION-FINDING , Funkpeilung / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06K Erkennen von Daten , RECOGNITION OF DATA / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL



    Camera-to-LiDAR calibration and validation

    PAUL AUREL DIEDERICHS / MAURILIO DI CICCO / JUN SHERN CHAN et al. | European Patent Office | 2023

    Free access

    An edge feature-based external calibration of monocular camera and LiDAR using in-orbit data

    Hu, Jiaqian / Song, Bin / Mu, Jinzhen et al. | Elsevier | 2024


    Line Feature Based Extrinsic Calibration of LiDAR and Camera

    Jiang, Jingjing / Xue, Peixin / Chen, Shitao et al. | IEEE | 2018


    Lidar to camera calibration for generating high definition maps

    WHEELER MARK DAMON / YANG LIN | European Patent Office | 2020

    Free access