Abstract Using the variational approaches to estimate optical flow between two frames, the flow discontinuities between different motion fields are usually not distinguished even when an anisotropic diffusion operator is applied. In this paper, we propose a multi-cue driven adaptive bilateral filter to regularize the flow computation, which is able to achieve the smoothly varied optical flow field with highly desirable motion discontinuities. First, we separate the traditional one-step variational updating model into a two-step filtering-based updating model. Then, employing our occlusion detector, we reformulate the energy functional of optical flow estimation by explicitly introducing an occlusion term to balance the energy loss due to the occlusion or mismatches. Furthermore, based on the two-step updating framework, a novel multi-cue driven bilateral filter is proposed to substitute the original anisotropic diffusion process, and it is able to adaptively control the diffusion process according to the occlusion detection, image intensity dissimilarity, and motion dissimilarity. After applying our approach on various video sources (movie and TV) in the presence of occlusion, motion blurring, non-rigid deformation, and weak textureness, we generate a spatial-coherent flow field between each pair of input frames and detect more accurate flow discontinuities along the motion boundaries.
Bilateral Filtering-Based Optical Flow Estimation with Occlusion Detection
Computer Vision – ECCV 2006 ; 3 ; 211-224
Lecture Notes in Computer Science ; 3951 , 3
2006-01-01
14 pages
Aufsatz/Kapitel (Buch)
Elektronische Ressource
Englisch
Bilateral Filtering-Based Optical Flow Estimation with Occlusion Detection
British Library Conference Proceedings | 2006
|Sparse Occlusion Detection with Optical Flow
British Library Online Contents | 2012
|Anisotropic Median Bilateral Filtering
TIBKAT | 2020
|Anisotropic Median Bilateral Filtering
Springer Verlag | 2020
|Three-Viewdense Disparity Estimation with Occlusion Detection
British Library Conference Proceedings | 2005
|