Title
Hon4D: Histogram Of Oriented 4D Normals For Activity Recognition From Depth Sequences
Keywords
3D; 4D; 4D Normals; Action Recognition; Activity Recognition; Depth; Histogram of Gradients; Histogram of Normals; HOG; HON; Kinect; MSR Action 3D; MSR Action Pairs; MSR Daily Activity; Polychoron; Shape
Abstract
We present a new descriptor for activity recognition from videos acquired by a depth sensor. Previous descriptors mostly compute shape and motion features independently, thus, they often fail to capture the complex joint shape-motion cues at pixel-level. In contrast, we describe the depth sequence using a histogram capturing the distribution of the surface normal orientation in the 4D space of time, depth, and spatial coordinates. To build the histogram, we create 4D projectors, which quantize the 4D space and represent the possible directions for the 4D normal. We initialize the projectors using the vertices of a regular polychoron. Consequently, we refine the projectors using a discriminative density measure, such that additional projectors are induced in the directions where the 4D normals are more dense and discriminative. Through extensive experiments, we demonstrate that our descriptor better captures the joint shape-motion cues in the depth sequence, and thus outperforms the state-of-the-art on all relevant benchmarks. © 2013 IEEE.
Publication Date
11-15-2013
Publication Title
Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition
Number of Pages
716-723
Document Type
Article; Proceedings Paper
Personal Identifier
scopus
DOI Link
https://doi.org/10.1109/CVPR.2013.98
Copyright Status
Unknown
Socpus ID
84887375927 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/84887375927
STARS Citation
Oreifej, Omar and Liu, Zicheng, "Hon4D: Histogram Of Oriented 4D Normals For Activity Recognition From Depth Sequences" (2013). Scopus Export 2010-2014. 6462.
https://stars.library.ucf.edu/scopus2010/6462