A system for recovering 3D hand pose from monocular color sequences is proposed. The system employs a non-linear supervised learning framework, the specialized mappings architecture (SMA), to map image features to likely 3D hand poses. The SMA's fundamental components are a set of specialized forward mapping functions, and a single feedback matching function. The forward functions are estimated directly from training data, which in our case are examples of hand joint configurations and their corresponding visual features. The joint angle data in the training set is obtained via a CyberGlove, a glove with 22 sensors that monitor the angular motions of the palm and fingers. In training, the visual features are generated using a computer graphics module that renders the hand from arbitrary viewpoints given the 22 joint angles. The viewpoint is encoded by two real values, therefore 24 real values represent a hand pose. We test our system both on synthetic sequences and on sequences taken with a color camera. The system automatically detects and tracks both bands of the user, calculates the appropriate features, and estimates the 3D hand joint angles and viewpoint from those features. Results are encouraging given the complexity of the task.
3D hand pose reconstruction using specialized mappings
Proceedings Eighth IEEE International Conference on Computer Vision. ICCV 2001 ; 1 ; 378-385 vol.1
2001-01-01
952407 byte
Conference paper
Electronic Resource
English
3D Hand Pose Reconstruction Using Specialized Mappings
British Library Conference Proceedings | 2001
|Adapting a Robot Hand to Specialized Functions
NTRS | 1987
|Hand Pose Estimation for Hand-Object Interaction Cases using Augmented Autoencoder
German Aerospace Center (DLR) | 2020
|Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer
German Aerospace Center (DLR) | 2019
|Template-Based Hand Pose Recognition Using Multiple Cues
British Library Conference Proceedings | 2006
|