Bin picking based on deep learning techniques is a promising approach that can solve several analytical methods problems. These systems can provide accurate solutions to bin picking in cluttered environments, where the scenario is always changing. This article proposes a robust and accurate system for segmenting bin picking objects, employing an easy configuration procedure to adjust the framework according to a specific object. The framework is implemented in Robot Operating System (ROS) and is divided into a detection and segmentation system. The detection system employs Mask R-CNN instance neural network to identify several objects from two dimensions (2D) grayscale images. The segmentation system relies on the point cloud library (PCL), manipulating 3D point cloud data according to the detection results to select particular points of the original point cloud, generating a partial point cloud result. Furthermore, to complete the bin picking system a pose estimation approach based on matching algorithms is employed, such as Iterative Closest Point (ICP). The system was evaluated for two types of objects, knee tube, and triangular wall support, in cluttered environments. It displayed an average precision of 79% for both models, an average recall of 92%, and an average IOU of 89%. As exhibited throughout the article, this system demonstrates high accuracy in cluttered environments with several occlusions for different types of objects.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Object Segmentation for Bin Picking Using Deep Learning


    Additional title:

    Lect. Notes in Networks, Syst.



    Conference:

    Iberian Robotics conference ; 2022 ; Zaragoza, Spain November 23, 2022 - November 25, 2022



    Publication date :

    2022-11-19


    Size :

    14 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    OBJECT PICKING-UP DEVICE

    SATO TAKASHI / KAKIHARA KIYOAKI / SAGO YUKINORI et al. | European Patent Office | 2022

    Free access

    Object picking device of high-position forklift

    SU MING / FANG XIAO / LI HE | European Patent Office | 2015

    Free access


    A survey on deep learning-based fine-grained object classification and semantic segmentation

    Zhao, B. / Feng, J. / Wu, X. et al. | British Library Online Contents | 2017


    Smart picking cart and method for picking using thereof

    CHUNG HOI HWAN / CHI SAM HYUN | European Patent Office | 2021

    Free access