General Visual Inspection is a manual inspection process regularly used to detect and localise obvious damage on the exterior of commercial aircraft. There has been increasing demand to perform this process at the boarding gate to minimise the downtime of the aircraft and automating this process is desired to reduce the reliance on human labour. Automating this typically requires estimating a camera’s pose with respect to the aircraft for initialisation but most existing localisation methods require infrastructure, which is very challenging in uncontrolled outdoor environments and within the limited turnover time (approximately 2 hours) on an airport tarmac. Additionally, many airlines and airports do not allow contact with the aircraft’s surface or using UAVs for inspection between flights, and restrict access to commercial aircraft. Hence, this paper proposes an on-site method that is infrastructure-free and easy to deploy for estimating a pan-tilt-zoom camera’s pose and localising scan images. This method initialises using the same pan-tilt-zoom camera used for the inspection task by utilising a Deep Convolutional Neural Network fine-tuned on only synthetic images to predict its own pose. We apply domain randomisation to generate the dataset for fine-tuning the network and modify its loss function by leveraging aircraft geometry to improve accuracy. We also propose a workflow for initialisation, scan path planning, and precise localisation of images captured from a pan-tilt-zoom camera. We evaluate and demonstrate our approach through experiments with real aircraft, achieving root-mean-square camera pose estimation errors of less than 0.24 m and 2° for all real scenes.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    CNN-Based Camera Pose Estimation and Localization of Scan Images for Aircraft Visual Inspection


    Contributors:


    Publication date :

    2024-08-01


    Size :

    2396443 byte




    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    A Visual-Based Aircraft Pose Estimation Method During Take-Off

    Liu, Feng / Zhang, Jong / Guo, Hao et al. | Springer Verlag | 2023


    Optimized camera pose estimation using iterative algorithm based on visual marker

    Alkhatib, M. N. / Bobkov, A. V. | American Institute of Physics | 2023


    PATTERN-BASED CAMERA POSE ESTIMATION SYSTEM

    AUGHEY JOHN H | European Patent Office | 2017

    Free access

    A performance study for camera pose estimation using visual marker based tracking

    Maidi, M. / Didier, J. Y. / Ababsa, F. et al. | British Library Online Contents | 2010


    Pattern-based camera pose estimation system

    AUGHEY JOHN H | European Patent Office | 2018

    Free access