Title

View Invariant Action Recognition Using Weighted Fundamental Ratios

Keywords

Action alignment; Action recognition; Fundamental ratios; Pose transition; View invariance

Abstract

In this paper, we fully investigate the concept of fundamental ratios, demonstrate their application and significance in view-invariant action recognition, and explore the importance of different body parts in action recognition. A moving plane observed by a fixed camera induces a fundamental matrix F between two frames, where the ratios among the elements in the upper left 2 × 2 submatrix are herein referred to as the fundamental ratios. We show that fundamental ratios are invariant to camera internal parameters and orientation, and hence can be used to identify similar motions of line segments from varying viewpoints. By representing the human body as a set of points, we decompose a body posture into a set of line segments. The similarity between two actions is therefore measured by the motion of line segments and hence by their associated fundamental ratios. We further investigate to what extent a body part plays a role in recognition of different actions and propose a generic method of assigning weights to different body points. Experiments are performed on three categories of data: the controlled CMU MoCap dataset, the partially controlled IXMAS data, and the more challenging uncontrolled UCF-CIL dataset collected on the internet. Extensive experiments are reported on testing (i) view-invariance, (ii) robustness to noisy localization of body points, (iii) effect of assigning different weights to different body points, (iv) effect of partial occlusion on recognition accuracy, and (v) determining how soon our method recognizes an action correctly from the starting point of the query video. © 2013 Elsevier Ltd. All rights reserved.

Publication Date

3-25-2013

Publication Title

Computer Vision and Image Understanding

Volume

117

Issue

6

Number of Pages

587-602

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1016/j.cviu.2013.01.006

Socpus ID

84875171134 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84875171134

This document is currently not available here.

Share

COinS