We propose a novel pipeline for unknown object grasping in shared robotic autonomy scenarios. State-of-the-art methods for fully autonomous scenarios are typically learning-based approaches optimised for a specific end-effector, that generate grasp poses directly from sensor input. In the domain of assistive robotics, we seek instead to utilise the user's cognitive abilities for enhanced satisfaction, grasping performance, and alignment with their high level task-specific goals. Given a pair of stereo images, we perform unknown object instance segmentation and generate a 3D reconstruction of the object of interest. In shared control, the user then guides the robot end-effector across a virtual hemisphere centered around the object to their desired approach direction. A physics-based grasp planner finds the most stable local grasp on the reconstruction, and finally the user is guided by shared control to this grasp. In experiments on the DLR EDAN platform, we report a grasp success rate of 87% for 10 unknown objects, and demonstrate the method's capability to grasp objects in structured clutter and from shelves.


    Access

    Download


    Export, share and cite



    Title :

    Unknown Object Grasping for Assistive Robotics


    Contributors:

    Publication date :

    2024


    Remarks:

    7 pages, 9 figures


    Type of media :

    Preprint


    Type of material :

    Electronic Resource


    Language :

    English




    Grasping Objects From the Floor in Assistive Robotics: Real World Implications and Lessons Learned

    Puente, Paloma de la / Fischinger, David / Bajones, Markus et al. | BASE | 2019

    Free access

    Cooperative grasping of an unknown object by multiple mobile robots

    Sasaki, J. / Ota, J. / Arai, T. et al. | British Library Online Contents | 1996


    Shared Control Templates for Assistive Robotics

    Quere, Gabriel / Hagengruber, Annette / Iskandar, Maged Samuel Zakri et al. | German Aerospace Center (DLR) | 2020

    Free access

    Task Understanding for Grasping Unknown Objects

    Kaneko, M. | British Library Online Contents | 1993


    Towards lifelong assistive robotics: a tight coupling between object perception and manipulation

    Hamidreza Kasaei, S. / Oliveira, Miguel / Lim, Gi Hyun et al. | BASE | 2018

    Free access