In the move towards image processing for Automated Integration and Testing (AIT) we explored defect detection on reflowed satellite PCBs using deep learning. To this end we utilized a convolutional neural network for semantic segmentation and subsequent instance segmentation for the detection of surface mounted devices, pollution and defects. A dataset of 16k labeled instances including devices, solder connections, solderballs, bridges and tombstoned components was created from our satellite fleet PCBs to train the network. The images were recorded using microscopes and industrial cameras and labeled using an active learning approach with human experts annotating the initial data. Then, the partially trained network labeled additional data with experts supervising the process and correcting predictions where necessary.We explored k-fold cross validation as well as dropout based uncertainty estimation for the prediction of samples that meaningfully extend our training data. Further we evaluated the benefits of the implemented procedures and the annotation speedup from the network assisted annotation. The resulting inspection system was successfully integrated into a human-robot collaborative workspace to increase its production efficiency.


    Access

    Download


    Export, share and cite



    Title :

    Microscopic Image Segmentation for Automated Inspection of Satellite Components


    Contributors:
    Bohlig, D. (author) / Leutert, F. (author) / Kempf, F. (author) / Möschwitzer, D. (author) / Schilling, K. (author)

    Publication date :

    2021


    Size :

    9 pages



    Type of media :

    Miscellaneous


    Type of material :

    Electronic Resource


    Language :

    English





    Automated inspection of ground metallic components [2249-22]

    Schroeder, F. D. / Crostack, H.-A. / SPIE | British Library Conference Proceedings | 1994


    Automated inspection, evaluation and measurement of complex geometry components

    Sergio Bilbao Fernandez de Leceta | Tema Archive | 2002


    Inspection with Robotic Microscopic Imaging

    Pedersen, Liam / Deans, Matthew / Kunz, Clay et al. | NTRS | 2005


    Inspection with Robotic Microscopic Imaging

    Pedersen, Liam / Deans, Matt / Kunz, Clay et al. | AIAA | 2005


    Automated inspection of complex composite components in the production cycle

    Maurer, Albrecht / Haase, Wolfgang / Henrich, Rudolf et al. | Tema Archive | 2008