Title

The differential use and effect of knowledge-based system explanations in novice and expert judgment decisions

Authors

Authors

V. Arnold; N. Clark; P. A. Collier; S. A. Leech;S. G. Sutton

Comments

Authors: contact us about adding a copy of your work at STARS@ucf.edu

Abbreviated Journal Title

Mis Q.

Keywords

explanations; explanation use; knowledge-based systems; expert systems; intelligent systems; THEORETICAL FOUNDATIONS; INTERFACE DESIGN; ADVICE; Computer Science, Information Systems; Information Science & Library; Science; Management

Abstract

Explanation facilities are considered essential in facilitating user interaction with knowledge-based systems (KBS). Research on explanation provision and the impact on KBS users has shown that the domain expertise affects the type of explanations selected by the user and the basis for seeking such explanations. The prior literature has been limited, however, by the use of simulated KBS that generally provide only feedback explanations (i.e., ex post to the recommendation of the KBS being presented to the user). The purpose of this study is to examine the way users with varying levels of expertise use alternative types of KBS explanations and the impact of that use on decision making. A total of 64 partner/manager-level and 82 senior/staff-level insolvency professionals participated in an experiment involving the use of a fully functioning KBS to complete a complex judgment task. In addition to feedback explanations, the KBS also provided feedforward explanations (i. e., general explanations during user input about the relationships between information cues in the KBS) and included definition type explanations (i.e., declarative-level knowledge). The results show that users were more likely to adhere to recommendations of the KBS when an explanation facility was available. Choice patterns in using explanations indicated that novices used feedforward explanations more than experts did, while experts were more likely than 170 vices to use feedback explanations. Novices also used more declarative knowledge and initial problem solving type explanations, while experts used more procedural knowledge explanations. Finally, use of feedback explanations led to greater adherence to the KBS recommendation by experts-a condition that was even more prevalent as the use of feedback explanations increased The results have several implications for the design and use of KBS in a professional decision-making environment.

Journal Title

Mis Quarterly

Volume

30

Issue/Number

1

Publication Date

1-1-2006

Document Type

Article

Language

English

First Page

79

Last Page

97

WOS Identifier

WOS:000235602600005

ISSN

0276-7783

Share

COinS