This paper considers the problem of fusing vision and touch senses together to estimate the 6D pose of an object while it is grasped. Assuming that a textured 3D model of the object is available, first, Scale-Invariant Feature Transform (SIFT) keypoints of the object are extracted, and a Random sample consensus (RANSAC) method is used to match these features with the textured model. Then, optical flow is used to visually track the object while a grasp is performed. After the hand contacts the object, a tactile-based pose estimation is performed using a Particle Filter. During grasp stabilization and hand movement, the pose of the object is continuously tracked by fusing the visual and tactile estimations with an extended Kalman filter. The main contribution of this work is the continuous use of both sensing modalities to reduce the uncertainty of tactile sensing in those degrees of freedom in which there is no information available, as presented through the experimental validation.
Visual and Tactile Fusion for Estimating the Pose of a Grasped Object
Advs in Intelligent Syst., Computing
Iberian Robotics conference ; 2019 ; Porto, Portugal November 20, 2019 - November 22, 2019
2019-11-20
15 pages
Article/Chapter (Book)
Electronic Resource
English
Toward active pose estimation of a grasped object [2056-09]
British Library Conference Proceedings | 1993
|Grasped Element Position Recognition and Robot Pose Adjustment during Assembly
BASE | 2019
|Estimation of Relative Orientation Between Robot Hand and Grasped Object
British Library Online Contents | 1995
|