Title

A Cautionary Note On Modeling Multitrait-Multirater Data Arising From Ill-Structured Measurement Designs

Keywords

confirmatory factor analysis; job performance ratings; measurement design

Abstract

The authors illustrate a problem with confirmatory factor analysis (CFA)-based strategies to model disaggregated multitrait-multirater (MTMR) data-the potential to find markedly different results with the same sample of ratees simply as a result of how one selects and identifies raters within the data set one has gathered for analysis. Using performance ratings gathered as part of a large criterion-related validation study, the authors show how such differences manifest themselves in several ways including variation in (a) covariance matrices that serve as input for the modeling effort, (b) model convergence, (c) admissibility of solutions, (d) overall model fit, (e) model parameter estimates, and (f) model selection. Implications of this study for past research and recommendations for future CFA-based MTMR modeling efforts are discussed. © The Author(s) 2011.

Publication Date

7-1-2011

Publication Title

Organizational Research Methods

Volume

14

Issue

3

Number of Pages

503-529

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1177/1094428110362107

Socpus ID

79957847421 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/79957847421

This document is currently not available here.

Share

COinS