We propose a novel method for extracting natural hand parameters from monocular image sequences. The purpose is to improve a vision-based sign language recognition system by providing detail information about the finger constellation and the 3D hand posture. Therefore, the hand is modelled by a set of 2D appearance models, each representing a limited variation range of 3D hand shape and posture. The single models are linked to each other according to the natural neighbourhood of the corresponding hand status. During an image sequence, necessary model transitions are executed towards one of the current neighbour models. The natural hand parameters are calculated from the shape and texture parameters of the current model, using a relation estimated by linear regression. The method is robust against large differences between subsequent frames and also against poor image quality. It can be implemented in real-time and offers good properties to handle occlusion and partly missing image information.
Extraction of 3D hand shape and posture from image sequences for sign language recognition
2003-01-01
470419 byte
Conference paper
Electronic Resource
English
Extraction of 3D Hand Shape and Posture from Image Sequences for Sign Language Recognition
British Library Conference Proceedings | 2003
|Appearance-Based Hand Sign Recognition from Intensity Image Sequences
British Library Online Contents | 2000
|Robust Road Sign Detection and Recognition from Image Sequences
British Library Conference Proceedings | 1994
|Modalities Combination for Italian Sign Language Extraction and Recognition
British Library Conference Proceedings | 2015
|Real-time hand posture recognition using range data
British Library Online Contents | 2008
|