This paper describes the implementation, demonstration and evaluation of a variety of autonomous, vision-guided manipulation capabilities, using a dual-arm Baxter robot. Initially, symmetric coordinated bi-manual manipulation based on kinematic tracking algorithm was implemented on the robot to enable a master-slave manipulation system. We demonstrate the efficacy of this approach with a human-robot collaboration experiment, where a human operator moves the master arm along arbitrary trajectories and the slave arm automatically follows the master arm while maintaining a constant relative pose between the two end-effectors. Next, this concept was extended to perform dual-arm manipulation without human intervention. To this extent, an image-based visual servoing scheme has been developed to control the motion of arms for positioning them at a desired grasp locations. Next we combine this with a dynamic position controller to move the grasped object using both arms in a prescribed trajectory. The presented approach has been validated by performing numerous symmetric and asymmetric bi-manual manipulations at different conditions. Our experiments demonstrated 80% success rate in performing the symmetric dual-arm manipulation tasks; and 73% success rate in performing asymmetric dualarm manipulation tasks.


    Access

    Download


    Export, share and cite



    Title :

    Autonomous vision-guided bi-manual grasping and manipulation


    Contributors:

    Publication date :

    2017-03-08


    Remarks:

    In: Proceedings of Advanced Robotics and its Social Impacts (ARSO). IEEE Xplore: Austin, TX, USA. (2017)


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    Stereo-Vision-Guided Object Grasping

    Nguyen, M.-C. / Graefe, V. / International Symposium on Automotive Technology and Automation | British Library Conference Proceedings | 1999


    Stereo-vision-guided object grasping

    Nguyen,M.C. / Graefe,V. / Univ.d.Bundeswehr Muenchen,DE | Automotive engineering | 1999


    Special issue on autonomous grasping and manipulation

    Ben Amor, H. | British Library Online Contents | 2014



    Foreword to the special issue on autonomous grasping and manipulation

    Hackett, D. | British Library Online Contents | 2014