Spatio-temporal regularity flow (SPREF): Its estimation and applications

    Authors

    O. Alatas; P. K. Yan;M. Shah

    Comments

    Authors: contact us about adding a copy of your work at STARS@ucf.edu

    Abbreviated Journal Title

    IEEE Trans. Circuits Syst. Video Technol.

    Keywords

    cross-sectional; parallelism; regularity modeling; spatio-temporal; feature; video compression; video inpainting; VIDEO COMPRESSION; MOTION; Engineering, Electrical & Electronic

    Abstract

    Feature selection and extraction is a key operation in video analysis for achieving a higher level of abstraction. In this paper, we introduce a general framework to extract a new spatio-temporal feature that represents the directions in which a video is regular, i.e., the pixel appearances change the least. We propose to model the directions of regular variations with a 3-D vector field, which is referred to as spatio-temporal regularity-flow (SPREF). SPREF vectors are designed to have three cross-sectional parallel components F-x, F-y, and F-t for convenient use in different applications. They are estimated using all the frames simultaneously by minimizing an energy functional formulated according to its definition. In this paper, we first introduce translational SPREF (T-SPREF) and then extend our framework to affine SPREF (A-SPREF). The successful use of SPREF in a few applications, including object removal, video inpainting, and video compression, is also demonstrated.

    Journal Title

    Ieee Transactions on Circuits and Systems for Video Technology

    Volume

    17

    Issue/Number

    5

    Publication Date

    1-1-2007

    Document Type

    Article

    Language

    English

    First Page

    584

    Last Page

    589

    WOS Identifier

    WOS:000246192100007

    ISSN

    1051-8215

    Share

    COinS