A system for recovering 3D hand pose from monocular color sequences is proposed. The system employs a non-linear supervised learning framework, the specialized mappings architecture (SMA), to map image features to likely 3D hand poses. The SMA's fundamental components are a set of specialized forward mapping functions, and a single feedback matching function. The forward functions are estimated directly from training data, which in our case are examples of hand joint configurations and their corresponding visual features. The joint angle data in the training set is obtained via a CyberGlove, a glove with 22 sensors that monitor the angular motions of the palm and fingers. In training, the visual features are generated using a computer graphics module that renders the hand from arbitrary viewpoints given the 22 joint angles. The viewpoint is encoded by two real values, therefore 24 real values represent a hand pose. We test our system both on synthetic sequences and on sequences taken with a color camera. The system automatically detects and tracks both bands of the user, calculates the appropriate features, and estimates the 3D hand joint angles and viewpoint from those features. Results are encouraging given the complexity of the task.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    3D hand pose reconstruction using specialized mappings


    Contributors:
    Rosales, R. (author) / Athitsos, V. (author) / Sigal, L. (author) / Sclaroff, S. (author)


    Publication date :

    2001-01-01


    Size :

    952407 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    3D Hand Pose Reconstruction Using Specialized Mappings

    Rosales, R. / Athitsos, V. / Sigal, L. et al. | British Library Conference Proceedings | 2001



    Hand Pose Estimation for Hand-Object Interaction Cases using Augmented Autoencoder

    Li, Shile / Wang, Haojie / Lee, Dongheui | German Aerospace Center (DLR) | 2020

    Free access

    Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer

    Li, Shile / Lee, Dongheui | German Aerospace Center (DLR) | 2019

    Free access

    Template-Based Hand Pose Recognition Using Multiple Cues

    Stenger, B. | British Library Conference Proceedings | 2006