Reactive grasping of objects is an essential capability of autonomous robot manipulation, which is yet challenging to learn such sensorimotor control to coordinate coherent hand-finger motions and be robust against disturbances and failures. This work proposed a deep reinforcement learning based scheme to train feedback control policies which can coordinate reaching and grasping actions in presence of uncertainties. We formulated geometric metrics and task-orientated quantities to design the reward, which enabled efficient exploration of grasping policies. Further, to improve the success rate, we deployed key initial states of difficult hand-finger poses to train policies to overcome potential failures due to challenging configurations. The extensive simulation validations and benchmarks demonstrated that the learned policy was robust to grasp both static and moving objects. Moreover, the policy generated successful failure recoveries within a short time in difficult configurations and was robust with synthetic noises in the state feedback which were unseen during training.


    Access

    Download


    Export, share and cite



    Title :

    Learning Motor Skills of Reactive Reaching and Grasping of Objects


    Contributors:
    Hu, W (author) / Yang, C (author) / Yuan, K (author) / Li, Z (author)

    Publication date :

    2022-03-28


    Remarks:

    In: Proceedings of the IEEE International Conference on Robotics and Biomimetics (ROBIO) 2021. (pp. pp. 452-457). Institute of Electrical and Electronics Engineers (IEEE) (2022)


    Type of media :

    Paper


    Type of material :

    Electronic Resource


    Language :

    English


    Classification :

    DDC:    629



    Infant manual performance during reaching and grasping for objects moving in depth

    Domellöf, Erik / Barbu-Roth, Marianne / Rönnqvist, Louise et al. | BASE | 2015

    Free access

    Discovery, segmentation and reactive grasping of unknown objects

    Schiebener, David / Schill, Julian / Asfour, Tamim | IEEE | 2012


    Dynamic Hand Space Envelope during Reaching and Grasping

    Choi, Jaewon / Bae, Sungchan / Armstrong, Thomas J. | SAE Technical Papers | 2008


    Programming-by-demonstration of reaching motions for robot grasping

    Skoglund, Alexander / Tegin, Johan / Iliev, Boyko et al. | BASE | 2009

    Free access

    Influence of Object Properties on Reaching and Grasping Tasks

    Choi, Jaewon / Bae, Sungchan / Armstrong, Thomas J. | SAE Technical Papers | 2008