A system for recovering 3D hand pose from monocular color sequences is proposed. The system employs a non-linear supervised learning framework, the specialized mappings architecture (SMA), to map image features to likely 3D hand poses. The SMA's fundamental components are a set of specialized forward mapping functions, and a single feedback matching function. The forward functions are estimated directly from training data, which in our case are examples of hand joint configurations and their corresponding visual features. The joint angle data in the training set is obtained via a CyberGlove, a glove with 22 sensors that monitor the angular motions of the palm and fingers. In training, the visual features are generated using a computer graphics module that renders the hand from arbitrary viewpoints given the 22 joint angles. The viewpoint is encoded by two real values, therefore 24 real values represent a hand pose. We test our system both on synthetic sequences and on sequences taken with a color camera. The system automatically detects and tracks both bands of the user, calculates the appropriate features, and estimates the 3D hand joint angles and viewpoint from those features. Results are encouraging given the complexity of the task.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    3D hand pose reconstruction using specialized mappings


    Beteiligte:
    Rosales, R. (Autor:in) / Athitsos, V. (Autor:in) / Sigal, L. (Autor:in) / Sclaroff, S. (Autor:in)


    Erscheinungsdatum :

    01.01.2001


    Format / Umfang :

    952407 byte




    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    3D Hand Pose Reconstruction Using Specialized Mappings

    Rosales, R. / Athitsos, V. / Sigal, L. et al. | British Library Conference Proceedings | 2001



    Hand Pose Estimation for Hand-Object Interaction Cases using Augmented Autoencoder

    Li, Shile / Wang, Haojie / Lee, Dongheui | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2020

    Freier Zugriff

    Point-to-Pose Voting based Hand Pose Estimation using Residual Permutation Equivariant Layer

    Li, Shile / Lee, Dongheui | Deutsches Zentrum für Luft- und Raumfahrt (DLR) | 2019

    Freier Zugriff

    Template-Based Hand Pose Recognition Using Multiple Cues

    Stenger, B. | British Library Conference Proceedings | 2006