We describe a learning based method for recovering 3D human body pose from single images and monocular image sequences. Our approach requires neither an explicit body model nor prior labelling of body pans in the image. Instead, it recovers pose by direct nonlinear regression against shape descriptor vectors extracted automatically from image silhouettes. For robustness against local silhouette segmentation errors, silhouette shape is encoded by histogram-of-shape-contexts descriptors. For the main regression, we evaluate both regularized least squares and relevance vector machine (RVM) regressors over both linear and kernel bases. The RVM's provide much sparser regressors without compromising performance, and kernel bases give a small but worthwhile improvement in performance. For realism and good generalization with respect to viewpoints, we train the regressors on images resynthesized from real human motion capture data, and test it both quantitatively on similar independent test data, and qualitatively on a real image sequence. Mean angular errors of 6-7 degrees are obtained - a factor of 3 better than the current state of the art for the much simpler upper body problem.


    Zugriff

    Zugriff prüfen

    Verfügbarkeit in meiner Bibliothek prüfen

    Bestellung bei Subito €


    Exportieren, teilen und zitieren



    Titel :

    3D human pose from silhouettes by relevance vector regression


    Beteiligte:
    Agarwal, A. (Autor:in) / Triggs, B. (Autor:in)


    Erscheinungsdatum :

    2004-01-01


    Format / Umfang :

    1144109 byte





    Medientyp :

    Aufsatz (Konferenz)


    Format :

    Elektronische Ressource


    Sprache :

    Englisch



    3D Human Pose from Silhouettes by Relevance Vector Regression

    Agarwal, A. / Triggs, B. / IEEE Computer Society | British Library Conference Proceedings | 2004



    Inferring 3D Body Pose from Silhouettes Using Activity Manifold Learning

    Elgammal, A. / Lee, C.-S. / IEEE Computer Society | British Library Conference Proceedings | 2004


    Compositional Human Pose Regression

    Liang, Shuang / Sun, Xiao / Wei, Yichen | British Library Online Contents | 2018


    Structure and motion from silhouettes

    Wong, K.-Y.K. / Cipolla, R. | IEEE | 2001