Visual sensor data of manual assembly operations offers rich information that can be extracted in order to analyze and digitalize the assembly. The worker’s interaction with tools and objects, as well as the spatial–temporal nature of assembly operations, makes the recognition and classification of assembly operations a complex task. Therefore, classical methods of computer vision do not provide a sufficient solution. This paper presents a recurrent neural network for the classification of manual assembly operations using visual sensor data and addresses the question as to what extent such a solution is feasible in terms of robustness and reliability. Since complex assembly operations are a combination of basic movements, four main assembly operations of the Methods Time-Measurement base operations are classified using a machine learning approach. A dataset of these four assembly operations, reach, grasp, move and release, containing RGB-, infrared-, and depth-data is used. A Convolutional Neural Network—Long Short Term Memory architecture is investigated regarding its applicability due to the spatial–temporal nature of the data.


    Access

    Download


    Export, share and cite



    Title :

    Classification of Assembly Operations Using Recurrent Neural Networks




    Publication date :

    2022-01-01


    Size :

    11 pages




    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English





    Microscopic Blood Cell Classification Using Inception Recurrent Residual Convolutional Neural Networks

    Alom, Md Zahangir / Yakopcic, Chris / Taha, Tarek M. et al. | IEEE | 2018


    Buoy Light Pattern Classification for Autonomous Ship Navigation Using Recurrent Neural Networks

    Scholler, Frederik E. T. / Nalpantidis, Lazaros / Blanke, Mogens | IEEE | 2022


    Driving behavior classification based on sensor data fusion using LSTM recurrent neural networks

    Saleh, Khaled / Hossny, Mohammed / Nahavandi, Saeid | IEEE | 2017


    Vehicle classification using a recurrent neural network (RNN)

    SALTI SAMUELE / SAMBO FRANCESCO / TACCARI LEONARDO et al. | European Patent Office | 2019

    Free access

    Vehicle classification from low-frequency GPS data with recurrent neural networks

    Simoncini, Matteo / Taccari, Leonardo / Sambo, Francesco et al. | BASE | 2018

    Free access