Data-driven approaches and human inspiration are fundamental to endow robotic manipulators with advanced autonomous grasping capabilities. However, to capitalize upon these two pillars, several aspects need to be considered, which include the number of human examples used for training; the need for having in advance all the required information for classification (hardly feasible in unstructured environments); the trade-off between the task performance and the processing cost. In this letter, we propose a RGB-based pipeline that can identify the object to be grasped and guide the actual execution of the grasping primitive selected through a combination of Convolutional and Gated Graph Neural Networks. We consider a set of human-inspired grasp strategies, which are afforded by the geometrical properties of the objects and identified from a human grasping taxonomy, and propose to learn new grasping skills with only a few examples. We test our framework with a manipulator endowed with an under-actuated soft robotic hand. Even though we use only 2D information to reduce the footprint of the network, we achieve 90% of successful identifications of the most appropriate human-inspired grasping strategy over ten different classes, of which three were few-shot learned, outperforming an ideal model trained with all the classes, in sample-scarce conditions.


    Zugriff

    Download


    Exportieren, teilen und zitieren



    Titel :

    Learning With Few Examples the Semantic Description of Novel Human-Inspired Grasp Strategies From RGB Data



    Erscheinungsdatum :

    2022-01-01



    Medientyp :

    Aufsatz (Zeitschrift)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch


    Klassifikation :

    DDC:    629



    A Bio-inspired Grasp Stiffness Control for Robotic Hands

    V. R. GARATE / M. POZZI / D. PRATTICHIZZO et al. | BASE | 2018

    Freier Zugriff

    Biologically-inspired 3D grasp synthesis based on visual exploration

    Recatalá, G. | British Library Online Contents | 2008


    Domain Adaptation Grasp Network for Novel Object Grasp Detection

    Cai, Xiangting / Xu, Xin / Ren, Shuai et al. | Springer Verlag | 2022



    Powered Human Grasp Assist

    Bridgwater, Lyndon | NTRS | 2012