MAUI avatars: Mirroring the user's sensed emotions via expressive multi-ethnic facial avatars

    Authors

    F. Nasoz;C. L. Lisetti

    Comments

    Authors: contact us about adding a copy of your work at STARS@ucf.edu

    Abbreviated Journal Title

    J. Vis. Lang. Comput.

    Keywords

    affective intelligent user interfaces; emotion recognition; PATH-ANALYSIS; MOTIVATION; INTERFACES; Computer Science, Software Engineering

    Abstract

    In this paper we describe the multimodal affective user interface (MAUI) we created to capture its users' emotional physiological signals via wearable computers and visualize the categorized signals in terms of recognized emotion. MAUI aims at (1) giving feedback to the users about their emotional states via various modalities (e.g. mirroring the users' facial expressions and describing verbally the emotional state via an anthropomorphic avatar) and (2) animating the avatar's facial expressions based on the users' captured signals. We first describe a version of MAUI which we developed as an in-house research tool for developing and testing affective computing research. We also discuss applications for which building intelligent user interfaces similar to MAUI can be useful and we suggest ways of adapting the MAUI approach to fit those specific applications. (C) 2006 Elsevier Ltd. All rights reserved.

    Journal Title

    Journal of Visual Languages and Computing

    Volume

    17

    Issue/Number

    5

    Publication Date

    1-1-2006

    Document Type

    Article

    Language

    English

    First Page

    430

    Last Page

    444

    WOS Identifier

    WOS:000240784600003

    ISSN

    1045-926X

    Share

    COinS