The segmentation of video sequences into regions underlying a coherent motion is one of the most important processing in video analysis and coding. In this paper, we propose a reliability measure that indicates to what extent an affine motion model represents the motion of an image region. This reliability measure is then proposed as a criterion to coherently merge moving image regions in a Minimum Description Length (MDL) framework. To overcome the region-based motion estimation and segmentation chicken and egg problem, the motion field estimation and the segmentation task are treated separately. After a global motion compensation, a local motion field estimation is carried out starting from a translational motion model. Concurrently, a Markov Random Field model based algorithm provides for an initial static image partition. The motion estimation and segmentation problem is then formulated in the view of the MDL principle. A merging stage based on a directed weighted graph gives the final spatio-temporal segmentation. The simulation results show the effectiveness of the proposed algorithm.


    Access

    Download


    Export, share and cite



    Title :

    A Robust Region Merging Technique for Video Sequence Spatio-Temporal Segmentation



    Publication date :

    1999-01-01



    Type of media :

    Conference paper


    Type of material :

    Electronic Resource


    Language :

    English



    Classification :

    DDC:    629



    Spatio-temporal segmentation of video data

    Wang, John / Adelson, Edward H. | SPIE | 1994


    A Spatio-Temporal Video Analysis System for Object Segmentation

    Xia, J. / Wang, Y. / IEEE | British Library Conference Proceedings | 2003



    Unified Spatio-Temporal Dynamic Routing for Efficient Video Object Segmentation

    Dang, Jisheng / Zheng, Huicheng / Xu, Xiaohao et al. | IEEE | 2024


    Watershed-Based Segmentation and Region Merging

    Bleau, A. / Leon, L. J. | British Library Online Contents | 2000