Title

Classification of Cinematographic Shots Using Lie Algebra and its Application to Complex Event Recognition

Authors

Authors

S. Bhattacharya; R. Mehran; R. Sukthankar;M. Shah

Comments

Authors: contact us about adding a copy of your work at STARS@ucf.edu

Abbreviated Journal Title

IEEE Trans. Multimedia

Keywords

Cinematographic shots; homography; lie algebra; multimedia event; recognition; shot classification; CAMERA MOTION PARAMETERS; QUALITATIVE ESTIMATION; VIDEO; FEATURES; Computer Science, Information Systems; Computer Science, Software; Engineering; Telecommunications

Abstract

In this paper, we propose a discriminative representation of a video shot based on its camera motion and demonstrate how the representation can be used for high level multimedia tasks like complex event recognition. In our technique, we assume that a homography exists between a pair of subsequent frames in a given shot. Using purely image-based methods, we compute homography parameters that serve as coarse indicators of the ambient camera motion. Next, using Lie algebra, we map the homography matrices to an intermediate vector space that preserves the intrinsic geometric structure of the transformation. The mappings are stacked temporally to generate vector time-series per shot. To extract meaningful features from time-series, we propose an efficient linear dynamical system based technique. The extracted temporal features are further used to train linear SVMs as classifiers for a particular shot class. In addition to demonstrating the efficacy of our method on a novel dataset, we extend its applicability to recognize complex events in large scale videos under unconstrained scenarios. Our empirical evaluations on eight cinematographic shot classes show that our technique performs close to approaches that involve extraction of 3-D trajectories using computationally prohibitive structure from motion techniques.

Journal Title

Ieee Transactions on Multimedia

Volume

16

Issue/Number

3

Publication Date

1-1-2014

Document Type

Article

Language

English

First Page

686

Last Page

696

WOS Identifier

WOS:000333111500010

ISSN

1520-9210

Share

COinS