The effect of two alternative scoring procedures on the reliability and validity of a multiple-choice video selection test

Abstract

The present study investigated whether the validity and reliability coefficients obtained for a multiple-choice test using the conventional binary scoring method differed significantly from the coefficients obtained using the a priori option-weighting method. Under the a priori option-weighting procedure, the item options were differentially weighted by judged degree of correctness. A total test score was computed by adding the weights associated with the examinee's responses. The total test score for the binary scoring procedure was simply the number of correct answers given by the examinee. A multiplechoice video selection test was administered to 186 examinees. At approximately the same time, job performance ratings were collected for the study participants. The reliability was estimated using Cronbach's coefficient alpha. The concurrent validity was estimated by correlating test scores with overall performance ratings. The results indicated that the estimated reliability was significantly higher for the a priori option-weighting method. However, there were no significant differences between the validity coefficients obtained for the alternative scoring procedures.

Notes

This item is only available in print in the UCF Libraries. If this is your thesis or dissertation, you can help us make it available online for use by researchers around the world by STARS for more information.

Graduation Date

1990

Semester

Fall

Advisor

Burroughs, Wayne A.

Degree

Master of Science (M.S.)

College

College of Arts and Sciences

Department

Psychology

Format

PDF

Pages

64 p.

Language

English

Length of Campus-only Access

None

Access Status

Masters Thesis (Open Access)

Identifier

DP0027726

Subjects

Arts and Sciences -- Dissertations, Academic; Dissertations, Academic -- Arts and Sciences

Accessibility Status

Searchable text

This document is currently not available here.

Share

COinS