Computer vision has been revolutionised in recent years by increased research in convolutional neural networks (CNNs); however, many challenges remain to be addressed in order to ensure fast and accurate image processing when applying these techniques to robotics. These challenges consist of handling extreme changes in scale, illumination, noise, and viewing angles of a moving object. The project main contribution is to provide insight on how to properly train a convolutional neural network (CNN), a specific type of DNN, for object tracking in the context of industrial robotics. The proposed solution aims to use a combination of documented approaches to replicate a pick-and-place task with an industrial robot using computer vision feeding a YOLOv3 CNN. Experimental tests, designed to investigate the requirements of training the CNN in this context, were performed using a variety of objects that differed in shape and size in a controlled environment. The general focus was to detect the objects based on their shape; as a result, a suitable and secure grasp could be selected by the robot. The findings in this article reflect the challenges of training the CNN through brute force. It also highlights the different methods of annotating images and the ensuing results obtained after training the neural network.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Object Classification for Robotic Platforms


    Additional title:

    Advs in Intelligent Syst., Computing



    Conference:

    Iberian Robotics conference ; 2019 ; Porto, Portugal November 20, 2019 - November 22, 2019



    Publication date :

    2019-11-20


    Size :

    12 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Object Classification for Robotic Platforms

    Brandenburg, Samuel / Machado, Pedro / Shinde, Pranjali et al. | TIBKAT | 2020


    Object and Gas Source Detection with Robotic Platforms in Perceptually Degraded Environments

    Agha-mohammadi, Ali-akbar / Daftry, Shreyansh / Morrell, Benjamin et al. | NTRS | 2020


    OCEAN OBSERVATION WITH COORDINATED ROBOTIC PLATFORMS

    Cruz, N.A. / Ferreira, B.M. / Matos, A.C. | British Library Online Contents | 2013


    FRUIT PICKING ROBOTIC INSTALLATION ON PLATFORMS

    MAOR YANIV | European Patent Office | 2023

    Free access

    Obstacle Avoidance Technologies for Robotic Platforms

    Kurtz, J. / Frederick, B. / Neubert, J. et al. | British Library Conference Proceedings | 1997