When estimating the dense motion field of a video sequence, if little is known or assumed about the content, a limited constraint approach such as optical flow must be used. Since optical flow algorithms generally use a small spatial area in the determination of each motion vector the resulting motion field can be noisy, particularly if the input video sequence is noisy. If the moving subject is known to be a face, then we may use that constraint to improve the motion field results. This paper describes a method for deriving dense motion field data using a face tracking approach. A face model is manually initialized to fit a face at the beginning of the input sequence. Then a Kalman filtering approach is used to track the face movements and successively fit the face model to the face in each frame. The 2D displacement vectors are calculated from the projection of the facial model, which is allowed to move in 3D space and may have a 3D shape. We have experimented with planar, cylindrical, and Candide face models. The resulting motion field is used in multiple frame restoration of a face in noisy video.
Model-based face tracking for dense motion field estimation
2001-01-01
639816 byte
Conference paper
Electronic Resource
English
Model-Based Face Tracking for Dense Motion Field Estimation
British Library Conference Proceedings | 2001
|Motion Tracking of Dense Feature Point Sets
British Library Conference Proceedings | 1997
|Model-based motion blur estimation for the improvement of motion tracking
British Library Online Contents | 2017
|Dense Motion Field Estimation using Spatial Filtering and Quasi Eigenfunction approximations
British Library Conference Proceedings | 2005
|