We present a novel fully automatic method for high resolution, nonrigid dense 3D point tracking. High quality dense point clouds of nonrigid geometry moving at video speeds are acquired using a phase-shifting structured light ranging technique. To use such data for the temporal study of subtle motions such as those seen in facial expressions, an efficient nonrigid 3D motion tracking algorithm is needed to establish inter-frame correspondences. The novelty of this paper is the development of an algorithmic framework for 3D tracking that unifies tracking of intensity and geometric features, using harmonic maps with added feature correspondence constraints. While the previous uses of harmonic maps provided only global alignment, the proposed introduction of interior feature constraints guarantees that nonrigid deformations are accurately tracked as well. The harmonic map between two topological disks is a diffeomorphism with minimal stretching energy and bounded angle distortion. The map is stable, insensitive to resolution changes and is robust to noise. Due to the strong implicit and explicit smoothness constraints imposed by the algorithm and the high-resolution data, the resulting registration/deformation field is smooth, continuous and gives dense one-to-one inter-frame correspondences. Our method is validated through a series of experiments demonstrating its accuracy and efficiency.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    High resolution tracking of non-rigid 3D motion of densely sampled data using harmonic maps


    Contributors:
    Yang Wang, (author) / Gupta, M. (author) / Song Zhang, (author) / Sen Wang, (author) / Xianfeng Gu, (author) / Samaras, D. (author) / Peisen Huang, (author)


    Publication date :

    2005-01-01


    Size :

    589916 byte





    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    High Resolution Tracking of Non-Rigid Motion of Densely Sampled 3D Data Using Harmonic Maps

    Wang, Y. / Gupta, M. / Zhang, S. et al. | British Library Online Contents | 2008


    High Resolution Tracking of Non-Rigid 3D Motion of Densely Sampled Data Using Harmonic Maps

    Wang, Y. / Gupta, M. / Zhang, S. et al. | British Library Conference Proceedings | 2005


    Tracking Densely Moving Markers

    Borghese, N. / Rigiroli, P. | British Library Conference Proceedings | 2002


    Spacecraft tracking using sampled-data Kalman filters

    Teixeira, B.O.S. / Santillo, M.A. / Erwin, R.S. et al. | Tema Archive | 2008


    Tracking Rigid Body Motion Using Thrusters and Momentum Wheels

    Hall, Christopher D. / Tsiotras, Panagiotis / Shen, Haijun | Springer Verlag | 2002