Camera systems in autonomous vehicles are subject to various sources of anticipated and unanticipated mechanical stress (vibration, rough handling, collisions) in real-world conditions. Even moderate changes in camera geometry due to mechanical stress decalibrate multi-camera systems and corrupt downstream applications like depth perception. We propose an on-the-fly stereo recalibration method applicable in real-world autonomous vehicles. The method is comprised of two parts. First, in optimization step, external camera parameters are optimized with the goal to maximise the amount of recovered depth pixels. In the second step, external sensor is used to adjust the scaling of the optimized camera model. The method is lightweight and fast enough to run in parallel with stereo estimation, thus allowing an on-the-fly recalibration. Our extensive experimental analysis shows that our method achieves stereo reconstruction better or on par with manual calibration. If our method is used on a sequence of images, the quality of calibration can be improved even further.


    Access

    Download


    Export, share and cite



    Title :

    Correcting decalibration of stereo cameras in self-driving vehicles


    Contributors:

    Publication date :

    2021-07-27


    Remarks:

    Sensors, vol. 20, no. 11, art 3241, 2020. ; ISSN: 1424-8220


    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629




    Stereo with Oblique Cameras

    Pajdla, T. / IEEE Computer Society | British Library Conference Proceedings | 2001


    Stereo with oblique cameras

    Pajdla, T. | IEEE | 2001




    Stereo with Oblique Cameras

    Pajdla, T. | British Library Online Contents | 2002