Robotic dexterous hands need to rely on both visual and tactile information for grasping during grasping and interaction. The position and type of objects are identified by visual information, and stable grasping is accomplished by tactile information. In this paper, a solution based on visual-tactile fusion control is proposed. At the same time, the data set is established by the method of tactile teaching to complete stable grasping. The tactile teaching approach is inspired by adults teaching children to write by hand. The “hand-held” grip method enables a more natural and convenient grip teaching. By fusing visual and tactile information, the perceptual capability and control accuracy of the robot’s dexterous hand are improved. Using the proposed method, a series of grasping tasks were tested in an experimental environment. The results show that the method can not only effectively improve the grasping success rate of the robot dexterous hand on objects of different shapes, but also achieve stable interaction between the robot dexterous hand and the objects.
Fully Tactile Dexterous Hand Grasping Strategy Combining Visual and Tactile Senses
Lect.Notes Computer
International Conference on Intelligent Robotics and Applications ; 2023 ; Hangzhou, China July 05, 2023 - July 07, 2023
2023-10-16
11 pages
Article/Chapter (Book)
Electronic Resource
English
Dexterous Hand , Visual-tactile Fusion , Tactile Teaching Computer Science , Artificial Intelligence , Software Engineering/Programming and Operating Systems , Computer Applications , User Interfaces and Human Computer Interaction , Computer Communication Networks , Special Purpose and Application-Based Systems
TIBKAT | 2023
|Towards Dexterous In-Hand Manipulation through Tactile Sensing
TIBKAT | 2018
|Tactile Feedback for Multifingered Dynamic Grasping
British Library Online Contents | 1997
|