A system performs calibration of sensors mounted on a vehicle, for example, lidar and camera sensors mounted on a vehicle, for example, an autonomous vehicle. The system receives a lidar scan and camera image of a view and determines a lidar-to-camera transform based on the lidar scan and the camera image. The system may use a pattern, for example, a checkerboard pattern in the view for calibration. The pattern is placed close to the vehicle to determine an approximate lidar-to-camera transform and then placed at a distance from the vehicle to determine an accurate lidar-to-camera transform. Alternatively, the system determines edges in the lidar scan and the camera image and aligns features based on real-world objects in the scene by comparing edges.


    Access

    Download


    Export, share and cite



    Title :

    Lidar to camera calibration based on edge detection


    Contributors:

    Publication date :

    2020-11-17


    Type of media :

    Patent


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    IPC:    B60R Fahrzeuge, Fahrzeugausstattung oder Fahrzeugteile, soweit nicht anderweitig vorgesehen , VEHICLES, VEHICLE FITTINGS, OR VEHICLE PARTS, NOT OTHERWISE PROVIDED FOR / G01C Messen von Entfernungen, Höhen, Neigungen oder Richtungen , MEASURING DISTANCES, LEVELS OR BEARINGS / G01S RADIO DIRECTION-FINDING , Funkpeilung / G05D SYSTEMS FOR CONTROLLING OR REGULATING NON-ELECTRIC VARIABLES , Systeme zum Steuern oder Regeln nichtelektrischer veränderlicher Größen / G06K Erkennen von Daten , RECOGNITION OF DATA / G06T Bilddatenverarbeitung oder Bilddatenerzeugung allgemein , IMAGE DATA PROCESSING OR GENERATION, IN GENERAL / H04N PICTORIAL COMMUNICATION, e.g. TELEVISION , Bildübertragung, z.B. Fernsehen



    Camera-to-LiDAR calibration and validation

    PAUL AUREL DIEDERICHS / MAURILIO DI CICCO / JUN SHERN CHAN et al. | European Patent Office | 2023

    Free access

    Line Feature Based Extrinsic Calibration of LiDAR and Camera

    Jiang, Jingjing / Xue, Peixin / Chen, Shitao et al. | IEEE | 2018


    LiDAR-Camera System Automatic Extrinsic Calibration in Rail Transit

    Wu, Qian / Zhang, Jin / Sheng, Jie et al. | IEEE | 2022


    Lidar to camera calibration for generating high definition maps

    WHEELER MARK DAMON / YANG LIN | European Patent Office | 2020

    Free access

    Extrinsic Calibration of a 3D-LIDAR and a Camera

    Mishra, Subodh / Pandey, Gaurav / Saripalli, Srikanth | IEEE | 2020