Title

Classification Of Cinematographic Shots Using Lie Algebra And Its Application To Complex Event Recognition

Keywords

Cinematographic shots; homography; lie algebra; multimedia event recognition; shot classification

Abstract

In this paper, we propose a discriminative representation of a video shot based on its camera motion and demonstrate how the representation can be used for high level multimedia tasks like complex event recognition. In our technique, we assume that a homography exists between a pair of subsequent frames in a given shot. Using purely image-based methods, we compute homography parameters that serve as coarse indicators of the ambient camera motion. Next, using Lie algebra, we map the homography matrices to an intermediate vector space that preserves the intrinsic geometric structure of the transformation. The mappings are stacked temporally to generate vector time-series per shot. To extract meaningful features from time-series, we propose an efficient linear dynamical system based technique. The extracted temporal features are further used to train linear SVMs as classifiers for a particular shot class. In addition to demonstrating the efficacy of our method on a novel dataset, we extend its applicability to recognize complex events in large scale videos under unconstrained scenarios. Our empirical evaluations on eight cinematographic shot classes show that our technique performs close to approaches that involve extraction of 3-D trajectories using computationally prohibitive structure from motion techniques. © 2014 IEEE.

Publication Date

1-1-2014

Publication Title

IEEE Transactions on Multimedia

Volume

16

Issue

3

Number of Pages

686-696

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/TMM.2014.2300833

Socpus ID

84896981536 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84896981536

This document is currently not available here.

Share

COinS