Title

Towards validation and refinement of rule-based systems

Authors

Authors

R. Knauf; I. Philippow;A. J. Gonzalez

Abbreviated Journal Title

J. Exp. Theor. Artif. Intell.

Keywords

evaluation; validation; rule-based systems; system refinement; test case; generation; Computer Science, Artificial Intelligence

Abstract

A methodology for the validation of rule-based expert systems is presented as a multi-step process that has three central themes: (1) creation of a useful set of test inputs that cover the domain; (2) a methodology that evaluates the system's responses to the test inputs and compares it to the responses of a panel of human experts, and (3) use of the validation results for system refinement. The presented methodology is performed in a loop. The starting point is a rule base and the loop ends up in a (hopefully) better rule base. The first three steps of this process have been published as separate issues in earlier papers by the authors. Here, these issues are just outlined and references are provided for detailed information. This paper gives an overview of the entire process and describes the relation between its steps. The last step, system refinement, is the new scientific issue here and thus, presented in more detail. Here, the rules are modified according to the results of evaluating the test cases. The base of this rule base reconstruction is both a 'rule-associated validity' and the existence of a 'better rated' human solution.

Journal Title

Journal of Experimental & Theoretical Artificial Intelligence

Volume

12

Issue/Number

4

Publication Date

1-1-2000

Document Type

Article

Language

English

First Page

421

Last Page

431

WOS Identifier

WOS:000166521400004

ISSN

0952-813X

Share

COinS