Modeling multimodal expression of user's affective subjective experience

    Authors

    N. Bianchi-Berthouze;C. L. Lisetti

    Comments

    Authors: contact us about adding a copy of your work at STARS@ucf.edu

    Abbreviated Journal Title

    User Model. User-Adapt. Interact.

    Keywords

    affect; embodiment; emotion; interaction; perception; subjective; experience; FACIAL EXPRESSIONS; EMOTIONS; IMAGES; Computer Science, Cybernetics

    Abstract

    With the growing importance of information technology in our everyday life, new types of applications are appearing that require the understanding of information in a broad sense. Information that includes affective and subjective content plays a major role not only in an individual's cognitive processes but also in an individual's interaction with others. We identify three key points to be considered when developing systems that capture affective information: embodiment (experiencing physical reality), dynamics (mapping experience and emotional state with its label) and adaptive interaction (conveying emotive response, responding to a recognized emotional state). We present two computational systems that implement those principles: MOUE (Model Of User Emotions) is an emotion recognition system that recognizes the user's emotion from his/her facial expressions, and from it, adaptively builds semantic definitions of emotion concepts using the user's feedback; MIKE (Multimedia Interactive Environment for Kansei communication) is an interactive adaptive system that, along with the user, co-evolves a language for communicating over subjective impressions.

    Journal Title

    User Modeling and User-Adapted Interaction

    Volume

    12

    Issue/Number

    1

    Publication Date

    1-1-2002

    Document Type

    Article

    Language

    English

    First Page

    49

    Last Page

    84

    WOS Identifier

    WOS:000172862500002

    ISSN

    0924-1868

    Share

    COinS