Robotic harvesting research has seen significant achievements in the past decade, with breakthroughs being made in machine vision, robot manipulation, autonomous navigation and mapping. However, the missing capability of obstacle handling during the grasping process has severely reduced harvest success rate and limited the overall performance of robotic harvesting. This work focuses on leaf interference caused slip detection and handling, where solutions to robotic grasping in an unstructured environment are proposed. Through analysis of the motion and force of fruit grasping under leaf interference, the connection between object slip caused by leaf interference and inadequate harvest performance is identified for the first time in the literature. A learning-based perception and manipulation method is proposed to detect slip that causes problematic grasps of objects, allowing the robot to implement timely reaction. Our results indicate that the proposed algorithm detects grasp slip with an accuracy of 94%. The proposed sensing-based manipulation demonstrated great potential in robotic fruit harvesting, and could be extended to other pick-place applications.


    Access

    Download


    Export, share and cite



    Title :

    Learning-based slip detection for robotic fruit grasping and manipulation under leaf interference


    Contributors:
    Zhou, Hongyu (author) / Xiao, Jinhui (author) / Kang, Hanwen (author) / Wang, Xing (author) / Au, Wesley (author) / Chen, Chao (author)

    Publication date :

    2022-07-22


    Remarks:

    Zhou , H , Xiao , J , Kang , H , Wang , X , Au , W & Chen , C 2022 , ' Learning-based slip detection for robotic fruit grasping and manipulation under leaf interference ' , Sensors , vol. 22 , no. 15 , 5843 . https://doi.org/10.3390/s22155483



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Reinforcement Learning for Robotic Grasping and Manipulation: A Review

    Donepudi, Praveen Kumar | BASE | 2020

    Free access


    Robotic grasping and Manipulation Controller Framework architecture redevelopment

    Dzitac, Pavel / Mazid, Abdul Md / Littlefair, Guy et al. | IEEE | 2014


    Grasping and manipulation by robotic arm/multifingered-hand mechanisms

    Nagai, K. / Yoshikawa, T. | British Library Online Contents | 1995