Title

Towards A Method For Evaluating Naturalness In Conversational Dialog Systems

Keywords

Artificial intelligence; Dialog systems; Human-computer interaction; Software evaluation

Abstract

The evaluation of conversational dialog systems has remained a controversial topic, as it is challenging to quantitatively assess how well a conversation agent performs, or how much better one is compared to another. Furthermore, one of the hurdles which remains elusive in this quandary is the definition of naturalness, as demonstrated by how well a dialog system can maintain a natural conversation flow devoid of perceived awkwardness. As a step towards defining the dimensions of effectiveness and naturalness in a dialog system, this paper identifies existing evaluation practices which are then expanded to develop a more suitable assessment vehicle. This method is then applied to the LifeLike virtual avatar project. ©2009 IEEE.

Publication Date

12-1-2009

Publication Title

Conference Proceedings - IEEE International Conference on Systems, Man and Cybernetics

Number of Pages

1236-1241

Document Type

Article; Proceedings Paper

Personal Identifier

scopus

DOI Link

https://doi.org/10.1109/ICSMC.2009.5345904

Socpus ID

74849113989 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/74849113989

This document is currently not available here.

Share

COinS