Classification of Cinematographic Shots Using Lie Algebra and its Application to Complex Event Recognition

    Authors

    S. Bhattacharya; R. Mehran; R. Sukthankar;M. Shah

    Comments

    Authors: contact us about adding a copy of your work at STARS@ucf.edu

    Abbreviated Journal Title

    IEEE Trans. Multimedia

    Keywords

    Cinematographic shots; homography; lie algebra; multimedia event; recognition; shot classification; CAMERA MOTION PARAMETERS; QUALITATIVE ESTIMATION; VIDEO; FEATURES; Computer Science, Information Systems; Computer Science, Software; Engineering; Telecommunications

    Abstract

    In this paper, we propose a discriminative representation of a video shot based on its camera motion and demonstrate how the representation can be used for high level multimedia tasks like complex event recognition. In our technique, we assume that a homography exists between a pair of subsequent frames in a given shot. Using purely image-based methods, we compute homography parameters that serve as coarse indicators of the ambient camera motion. Next, using Lie algebra, we map the homography matrices to an intermediate vector space that preserves the intrinsic geometric structure of the transformation. The mappings are stacked temporally to generate vector time-series per shot. To extract meaningful features from time-series, we propose an efficient linear dynamical system based technique. The extracted temporal features are further used to train linear SVMs as classifiers for a particular shot class. In addition to demonstrating the efficacy of our method on a novel dataset, we extend its applicability to recognize complex events in large scale videos under unconstrained scenarios. Our empirical evaluations on eight cinematographic shot classes show that our technique performs close to approaches that involve extraction of 3-D trajectories using computationally prohibitive structure from motion techniques.

    Journal Title

    Ieee Transactions on Multimedia

    Volume

    16

    Issue/Number

    3

    Publication Date

    1-1-2014

    Document Type

    Article

    Language

    English

    First Page

    686

    Last Page

    696

    WOS Identifier

    WOS:000333111500010

    ISSN

    1520-9210

    Share

    COinS