Ticnn: A Hierarchical Deep Learning Framework For Still Image Action Recognition Using Temporal Image Prediction

Keywords

Predicted temporal patterns; Still image action recognition; Tensor decomposition

Abstract

Lack of temporal information in still images is a major obstacle in still image action recognition. Here, we propose TICNN, a novel deep learning framework, addressing this challenge. We first introduce the concept of a Temporal Image, a compact representation of hypothetical sequence of images. We then take advantage of this concept to architect TICNN, composed of two convolutional neural networks. The first CNN learns a novel model to predict temporal images using transfer learning. Our second CNN extracts temporal image features to classify human actions in still images. Unlike previous efforts, TICNN learns temporal information, the missing cue, in a still image rather than merely focusing on spatial features. To the best of our knowledge, this is the first attempt to predict temporal images, dynamic patterns of a still image, to alleviate the lack of motion information in still images. Extensive experiments on four benchmarks demonstrate the positive effect of temporal image prediction on the accuracy of still image action recognition, outperforming the state-of-the-art methods in the literature.

Publication Date

8-29-2018

Publication Title

Proceedings - International Conference on Image Processing, ICIP

Number of Pages

3463-3467

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/ICIP.2018.8451193

Socpus ID

85062903143 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/85062903143

This document is currently not available here.

Share

COinS