This article proposes a novel method that can automatically and accurately recognize the pose change of binocular stereo cameras in real time and correct these changes. Focused on predicting a five degree-of-freedom extrinsic pose, we design a convolutional neural network (CNN) that implements the regression of rotation angles of two cameras. The proposed method increases regression accuracy using the information inherent in the entire image. To this end, the CNN divides the image into patches of a certain size, extracts detailed features and context features of the patches, and extracts attention information for patches belonging to the left and right images. Training and evaluating the CNN requires many stereo images with variations from the initial setup of the cameras. We solve this problem using miscalibration. In miscalibration, angles expected to be rotated for the three axes of the left and right cameras are randomly sampled within a range of ±2.5°, and a pair of rectified images are transformed using the sampled angles. The CNN uses these transformed images to infer the angle at which the camera axis is expected to have been rotated. Then, the pair of transformed images are corrected with these inferred angles. The superiority of the proposed method is demonstrated using the KITTI odometry dataset and the GY dataset we built.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    A CNN-Based Online Self-Calibration of Binocular Stereo Cameras for Pose Change


    Beteiligte:
    Song, Jin Gyu (Autor:in) / Lee, Joon Woong (Autor:in)

    Erschienen in:

    Erscheinungsdatum :

    01.01.2024


    Format / Umfang :

    3493226 byte




    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    CONTINUOUS EXTRINSIC ONLINE CALIBRATION FOR STEREO CAMERAS

    Mueller, Georg R. / Wuensche, Hans-Joachim | British Library Conference Proceedings | 2016


    Binocular Spherical Stereo

    Li, S. | Online Contents | 2008


    Binocular Spherical Stereo

    Shigang Li, | IEEE | 2008


    Active binocular stereo

    Maru, N. / Nishikawa, A. / Miyazaki, F. et al. | IEEE | 1993


    Occlusions and Binocular Stereo

    Geiger, D. / Ladendorf, B. / Yuille, A. | British Library Online Contents | 1995