The effect of two alternative scoring procedures on the reliability and validity of a multiple-choice video selection test
Abstract
The present study investigated whether the validity and reliability coefficients obtained for a multiple-choice test using the conventional binary scoring method differed significantly from the coefficients obtained using the a priori option-weighting method. Under the a priori option-weighting procedure, the item options were differentially weighted by judged degree of correctness. A total test score was computed by adding the weights associated with the examinee's responses. The total test score for the binary scoring procedure was simply the number of correct answers given by the examinee. A multiplechoice video selection test was administered to 186 examinees. At approximately the same time, job performance ratings were collected for the study participants. The reliability was estimated using Cronbach's coefficient alpha. The concurrent validity was estimated by correlating test scores with overall performance ratings. The results indicated that the estimated reliability was significantly higher for the a priori option-weighting method. However, there were no significant differences between the validity coefficients obtained for the alternative scoring procedures.
Notes
This item is only available in print in the UCF Libraries. If this is your thesis or dissertation, you can help us make it available online for use by researchers around the world by STARS for more information.
Graduation Date
1990
Semester
Fall
Advisor
Burroughs, Wayne A.
Degree
Master of Science (M.S.)
College
College of Arts and Sciences
Department
Psychology
Format
Pages
64 p.
Language
English
Length of Campus-only Access
None
Access Status
Masters Thesis (Open Access)
Identifier
DP0027726
Subjects
Arts and Sciences -- Dissertations, Academic; Dissertations, Academic -- Arts and Sciences
STARS Citation
Phillips, Lori Ann, "The effect of two alternative scoring procedures on the reliability and validity of a multiple-choice video selection test" (1990). Retrospective Theses and Dissertations. 4061.
https://stars.library.ucf.edu/rtd/4061
Accessibility Status
Searchable text