Improving Egocentric Vision Of Daily Activities

Keywords

Activities of Daily Living; Egocentric vision; Object Detection; Scene Identification

Abstract

In this paper, we investigates the interplay between scene and objects on daily activities under egocentric vision constraints. The nature of egocentric vision implies that the identity of the current scene remains consistent for several frames. We showed that this constraint can be used to improve several scene identification baselines including the current state of the art scene identification method. We also show that the scene identity can be used to improve the object detection. In generic object detection, models for objects typically only considers local context, ignoring the global scene context; however in daily activities, objects are typically associated to particular types of scenes. We exploited this context clue to re-score the object detectors. Re-scoring function is learned from scene classifiers and object detectors in a validation set. In testing time, models of objects are weighted according to the scene identity score (context) of the tested frame, improving the object detection as measured by mAP, respect to object detectors without the scene identity clue. Our experiments were performed in the Activities of Daily Living (ADL) public dataset [1] which is a standard benchmark for egocentric vision.

Publication Date

12-9-2015

Publication Title

Proceedings - International Conference on Image Processing, ICIP

Volume

2015-December

Number of Pages

2562-2566

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/ICIP.2015.7351265

Socpus ID

84956650691 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84956650691

This document is currently not available here.

Share

COinS