Multiwave: Complex Hand Gesture Recognition Using The Doppler Effect

Abstract

We built an acoustic, gesture-based recognition system called Multiwave, which leverages the Doppler Effect to translate multidimensional movements into user interface commands. Our system only requires the use of a speaker and microphone to be operational, but can be augmented with more speakers. Since these components are already included in most end user systems, our design makes gesture-based input more accessible to a wider range of end users. We are able to detect complex gestures by generating a known high frequency tone from multiple speakers and detecting movement using changes in the sound waves. We present the results of a user study of Multiwave to evaluate recognition rates for different gestures and report error rates comparable to or better than the current state of the art despite additional complexity. We also report subjective user feedback and some lessons learned from our system that provide additional insight for future applications of multidimensional acoustic gesture recognition.

Publication Date

1-1-2017

Publication Title

Proceedings - Graphics Interface

Number of Pages

97-103

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

Socpus ID

85044819919 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/85044819919

This document is currently not available here.

Share

COinS