Title

Motion Layer Extraction In The Presence Of Occlusion Using Graph Cuts

Keywords

Graph cuts; Layer-based motion segmentation; Level set representation; Occlusion order constraint; Video analysis

Abstract

Extracting layers from video is very important for video representation, analysis, compression, and synthesis. Assuming that a scene can be approximately described by multiple planar regions, this paper describes a robust and novel approach to automatically extract a set of affine or projective transformations induced by these regions, detect the occlusion pixels over multiple consecutive frames, and segment the scene into several motion layers. First, after determining a number of seed regions using correspondences in two frames, we expand the seed regions and reject the outliers employing the graph cuts method integrated with level set representation. Next, these initial regions are merged into several initial layers according to the motion similarity. Third, an occlusion order constraint on multiple frames is explored, which enforces that the occlusion area increases with the temporal order in a short period and effectively maintains segmentation consistency over multiple consecutive frames. Then, the correct layer segmentation is obtained by using a graph cuts algorithm and the occlusions between the overlapping layers are explicitly determined. Several experimental results are demonstrated to show that our approach is effective and robust. © 2005 IEEE.

Publication Date

10-1-2005

Publication Title

IEEE Transactions on Pattern Analysis and Machine Intelligence

Volume

27

Issue

10

Number of Pages

1644-1659

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/TPAMI.2005.202

Socpus ID

27644567619 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/27644567619

This document is currently not available here.

Share

COinS