Title

Video Scene Segmentation Using Markov Chain Monte Carlo

Keywords

Markov chain Monte Carlo; Video scene segmentation

Abstract

Videos are composed of many shots that are caused by different camera operations, e.g., on/off operations and switching between cameras. One important goal in video analysis is to group the shots into temporal scenes, such that all the shots in a single scene are related to the same subject, which could be a particular physical setting, an ongoing action or a theme. In this paper, we present a general framework for temporal scene segmentation in various video domains. The proposed method is formulated in a statistical fashion and uses the Markov chain Monte Carlo (MCMC) technique to determine the boundaries between video scenes. In this approach, a set of arbitrary scene boundaries are initialized at random locations and are automatically updated using two types of updates: diffusion and jumps. Diffusion is the process of updating the boundaries between adjacent scenes. Jumps consist of two reversible operations: the merging of two scenes and the splitting of an existing scene. The posterior probability of the target distribution of the number of scenes and their corresponding boundary locations is computed based on the model priors and the data likelihood. The updates of the model parameters are controlled by the hypothesis ratio test in the MCMC process, and the samples are collected to generate the final scene boundaries. The major advantage of the proposed framework is two-fold: 1) it is able to find the weak boundaries as well as the strong boundaries, i.e., it does not rely on the fixed threshold; 2) it can be applied to different video domains. We have tested the proposed method on two video domains: home videos and feature films, and accurate results have been obtained. © 2006 IEEE.

Publication Date

8-1-2006

Publication Title

IEEE Transactions on Multimedia

Volume

8

Issue

4

Number of Pages

686-697

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/TMM.2006.876299

Socpus ID

33746592540 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/33746592540

This document is currently not available here.

Share

COinS