The effect of two alternative scoring procedures on the reliability and validity of a multiple-choice video selection test
The present study investigated whether the validity and reliability coefficients obtained for a multiple-choice test using the conventional binary scoring method differed significantly from the coefficients obtained using the a priori option-weighting method. Under the a priori option-weighting procedure, the item options were differentially weighted by judged degree of correctness. A total test score was computed by adding the weights associated with the examinee's responses. The total test score for the binary scoring procedure was simply the number of correct answers given by the examinee. A multiplechoice video selection test was administered to 186 examinees. At approximately the same time, job performance ratings were collected for the study participants. The reliability was estimated using Cronbach's coefficient alpha. The concurrent validity was estimated by correlating test scores with overall performance ratings. The results indicated that the estimated reliability was significantly higher for the a priori option-weighting method. However, there were no significant differences between the validity coefficients obtained for the alternative scoring procedures.
This item is only available in print in the UCF Libraries. If this is your thesis or dissertation, you can help us make it available online for use by researchers around the world by downloading and filling out the Internet Distribution Consent Agreement. You may also contact the project coordinator Kerri Bottorff for more information.
Burroughs, Wayne A.
Master of Science (M.S.)
College of Arts and Sciences
Length of Campus-only Access
Masters Thesis (Open Access)
Arts and Sciences -- Dissertations, Academic; Dissertations, Academic -- Arts and Sciences
Phillips, Lori Ann, "The effect of two alternative scoring procedures on the reliability and validity of a multiple-choice video selection test" (1990). Retrospective Theses and Dissertations. 4061.