In autonomous driving applications, the calibration accuracy of the camera can directly affect the accuracy of perception or depth estimation. For online calibration of surround-view cameras, traditional feature extraction-based methods will suffer from strong distortion when the initial extrinsic parameters error is large, making these methods less robust and inaccurate. More existing methods use the sparse direct method to calibrate multi-cameras, which can ensure both accuracy and real-time performance and is theoretically achievable. However, this method requires a better initial value, and the initial estimate with a large error is often stuck in a local optimum. To this end, we introduce a robust automatic multi-cameras (pinhole or fisheye cameras) calibration and refinement method in the road scene. We utilize the deviable coarse-to-fine random-search strategy, and it can solve large disturbances of initial extrinsic parameters, which can make up for falling into local optimal domainin nonlinear optimization methods. In the photometric optimization stage, we add the weight of image adaptive binarization to solve the error caused by different camera exposure problems. To address the impact of non-roads on optimization, we use a road segmentation module instead of artificially specified fixed optimization regions. In the end, quantitative and qualitative experiments are conducted in actual and simulated environments, and the result shows the proposed method can achieve accuracy and robustness performance.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Automatic Multi-Camera Calibration and Refinement Method in Road Scene for Self-Driving Car


    Contributors:
    Li, Jixiang (author) / Pi, Jiahao (author) / Wei, Pengjin (author) / Luo, Zhaotong (author) / Yan, Guohang (author)

    Published in:

    Publication date :

    2024-01-01


    Size :

    4774402 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Automobile automatic driving system in self-adaptive multi-change scene

    PAN YUE / LIANG MEIYU / QIAN MINGPENG et al. | European Patent Office | 2023

    Free access

    Automatic driving method and device for road scene beyond ODD range

    HE TE | European Patent Office | 2024

    Free access

    Simulation test method and device for road and scene in automatic driving

    LI SENLIN / ZHENG WEIMIN / ZHU GUANGHUA | European Patent Office | 2023

    Free access

    Scene self-deduction engine design method for automatic driving test

    HU JIA / XU TIAN / LAI JINTAO et al. | European Patent Office | 2023

    Free access

    Automatic driving lane changing method for conical barrel road closure scene and vehicle

    MIAO YIWEN / ZHANG XIANHONG / KOYO | European Patent Office | 2024

    Free access