This paper considers the problem of fusing vision and touch senses together to estimate the 6D pose of an object while it is grasped. Assuming that a textured 3D model of the object is available, first, Scale-Invariant Feature Transform (SIFT) keypoints of the object are extracted, and a Random sample consensus (RANSAC) method is used to match these features with the textured model. Then, optical flow is used to visually track the object while a grasp is performed. After the hand contacts the object, a tactile-based pose estimation is performed using a Particle Filter. During grasp stabilization and hand movement, the pose of the object is continuously tracked by fusing the visual and tactile estimations with an extended Kalman filter. The main contribution of this work is the continuous use of both sensing modalities to reduce the uncertainty of tactile sensing in those degrees of freedom in which there is no information available, as presented through the experimental validation.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Visual and Tactile Fusion for Estimating the Pose of a Grasped Object


    Additional title:

    Advs in Intelligent Syst., Computing



    Conference:

    Iberian Robotics conference ; 2019 ; Porto, Portugal November 20, 2019 - November 22, 2019



    Publication date :

    2019-11-20


    Size :

    15 pages





    Type of media :

    Article/Chapter (Book)


    Type of material :

    Electronic Resource


    Language :

    English




    Visual and Tactile Fusion for Estimating the Pose of a Grasped Object

    Álvarez, David / Roa, Máximo A. / Moreno, Luis | TIBKAT | 2020


    Toward active pose estimation of a grasped object [2056-09]

    Abbott, A. L. / SPIE | British Library Conference Proceedings | 1993


    Grasped Element Position Recognition and Robot Pose Adjustment during Assembly

    Iturralde, Kepa / Kinoshita, Taku / Bock, Thomas | BASE | 2019

    Free access

    Estimation of Relative Orientation Between Robot Hand and Grasped Object

    Funahashi, Y. / Yamada, T. | British Library Online Contents | 1995