When estimating the dense motion field of a video sequence, if little is known or assumed about the content, a limited constraint approach such as optical flow must be used. Since optical flow algorithms generally use a small spatial area in the determination of each motion vector the resulting motion field can be noisy, particularly if the input video sequence is noisy. If the moving subject is known to be a face, then we may use that constraint to improve the motion field results. This paper describes a method for deriving dense motion field data using a face tracking approach. A face model is manually initialized to fit a face at the beginning of the input sequence. Then a Kalman filtering approach is used to track the face movements and successively fit the face model to the face in each frame. The 2D displacement vectors are calculated from the projection of the facial model, which is allowed to move in 3D space and may have a 3D shape. We have experimented with planar, cylindrical, and Candide face models. The resulting motion field is used in multiple frame restoration of a face in noisy video.


    Access

    Check access

    Check availability in my library

    Order at Subito €


    Export, share and cite



    Title :

    Model-based face tracking for dense motion field estimation


    Contributors:
    Gee, T.F. (author) / Mersereau, R.M. (author)


    Publication date :

    2001-01-01


    Size :

    639816 byte




    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Model-Based Face Tracking for Dense Motion Field Estimation

    Gee, T. F. / Mersereau, R. M. | British Library Conference Proceedings | 2001


    Motion Tracking of Dense Feature Point Sets

    Chetverikov, D. / Verestoy, J. / Austrian Association for Pattern Recognition | British Library Conference Proceedings | 1997


    Model-based motion blur estimation for the improvement of motion tracking

    Seibold, Clemens / Hilsmann, Anna / Eisert, Peter | British Library Online Contents | 2017



    Dense Motion Field Estimation using Spatial Filtering and Quasi Eigenfunction approximations

    Kristoffersen, E. / Austvoll, I. / Engan, K. | British Library Conference Proceedings | 2005