The final publication is available at link.springer.com ; In this paper, we simultaneously estimate camera pose and non-rigid 3D shape from a monocular video, using a sequential solution that combines local and global representations. We model the object as an ensemble of particles, each ruled by the linear equation of the Newton's second law of motion. This dynamic model is incorporated into a bundle adjustment framework, in combination with simple regularization components that ensure temporal and spatial consistency. The resulting approach allows to sequentially estimate shape and camera poses, while progressively learning a global low-rank model of the shape that is fed back into the optimization scheme, introducing thus, global constraints. The overall combination of local (physical) and global (statistical) constraints yields a solution that is both efficient and robust to several artifacts such as noisy and missing data or sudden camera motions, without requiring any training data at all. Validation is done in a variety of real application domains, including articulated and non-rigid motion, both for continuous and discontinuous shapes. Our on-line methodology yields significantly more accurate reconstructions than competing sequential approaches, being even comparable to the more computationally demanding batch methods. ; Peer Reviewed ; Postprint (author's final draft)


    Access

    Download


    Export, share and cite



    Title :

    Combining local-physical and global-statistical models for sequential deformable shape from motion



    Publication date :

    2017-04-01



    Type of media :

    Article (Journal)


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Combining Local-Physical and Global-Statistical Models for Sequential Deformable Shape from Motion

    Agudo, A. / Moreno-Noguer, F. | British Library Online Contents | 2017



    MetaMorphs: Deformable Shape and Texture Models

    Huang, X. / Metaxas, D. / Chen, T. et al. | British Library Conference Proceedings | 2004


    MetaMorphs: Deformable shape and texture models

    Xiaolei Huang, / Metaxas, D. / Ting Chen, | IEEE | 2004


    Deformable Model-Based Shape and Motion Analysis from Images using Motion Residual Error

    DeCarlo, D. / Metaxas, D. / IEEE; Computer Society | British Library Conference Proceedings | 1998