This work presents a machine vision system for the localization of strawberries and environment perception in a strawberry-harvesting robot for use in table-top strawberry production. A deep convolutionalneuralnetworkforsegmentationisutilizedtodetectthestrawberries.Segmentedstrawberries are localized through coordinate transformation, density base point clustering and the proposed location approximation method. To avoid collisions between the gripper and fixed obstacles, the safe manipulation region is limited to the space in front of the table and underneath the strap. Therefore, a safe region classification algorithm, based on Hough Transform algorithm, is proposed to segment the strap masks into a belt region in order to identify the pickable strawberries located underneath the strap. Similarly, a safe region classification algorithm is proposed for the table, to calculate its points in 3D and fit the points onto a 3D plane based on the 3D point cloud, so that pickable strawberries in front of the table can be identified. Experimentaltestsshowedthatthealgorithmcouldaccuratelyclassifyripeandunripestrawberriesandcould identify whether the strawberries are within the safe region for harvesting. Furthermore, harvester robot’s optimized localization method could accurately locate the strawberry targets with a picking accuracy rate of 74.1% in modified situations. ; publishedVersion


    Access

    Download


    Export, share and cite



    Title :

    Fruit localization and environment perception for strawberry harvesting robots


    Contributors:

    Publication date :

    2019-10-07


    Remarks:

    cristin:1734374
    147642-147652 ; 7 ; IEEE Access



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629




    Fruit Harvesting Robots in Japan

    Kondo, N. / Monta, M. / Fujiura, T. et al. | British Library Conference Proceedings | 1995


    Fruit Harvesting Robots in Japan

    Kondo, N. | Online Contents | 1996


    Obstacle-Avoidance Algorithm for Fruit Harvesting Robots

    Ryuh, Y. S. / Ryu, K. H. / Japanese Society of Agricultural Machinary | British Library Conference Proceedings | 1995


    Towards Automated Strawberry Harvesting: Identifying the Picking Point

    Huang, Zhuoling / Wane, Sam / Parsons, Simon | British Library Conference Proceedings | 2017


    Fruit Harvesting Apparatus

    PARK TAE IG | European Patent Office | 2018

    Free access