Title

Resolving Hand Over Face Occlusion

Keywords

HCI; Human-computer interaction; Occlusion

Abstract

The ability to segment or track the hand is an important problem in computer vision. While various solutions have been proposed, many methods do not work against complex or cluttered backgrounds. Solving these cases is essential to solving many problems in the domain of computer vision such as, human-computer interaction (HCI), surveillance, and virtual reality (i.e., augmented desks). This paper presents a method to segment the hand over complex backgrounds, such as the face. The similar colors and texture of the hand and face make the problem particularly challenging. The method is not restricted to only segmenting hands across faces and uses no knowledge of hands. Our method is based on the underlying concept of an image force field. In this representation change is measured through how particles move through the field. Each individual image location consists of a vector value which is a nonlinear combination of the remaining pixels in the image. We introduce and develop a novel physics-based feature that is able to measure regional structure in the image thus avoiding the problem of local pixel-based analysis, which breaks down under our conditions. The regional image structure changes in the occluded region during occlusion, while elsewhere the regional structure remains relatively constant. We model the regional image structure at all image locations over time using a mixture of Gaussians (MoG) to detect the occluded region in the image. We have tested the method on a number of sequences demonstrating the versatility of the proposed approach. © 2006 Elsevier B.V. All rights reserved.

Publication Date

9-1-2007

Publication Title

Image and Vision Computing

Volume

25

Issue

9

Number of Pages

1432-1448

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1016/j.imavis.2006.12.012

Socpus ID

34250178074 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/34250178074

This document is currently not available here.

Share

COinS