Title

The Psychometrics of Mental Workload: Multiple Measures Are Sensitive but Divergent

Authors

Authors

G. Matthews; L. E. Reinerman-Jones; D. J. Barber;J. Abich

Comments

Authors: contact us about adding a copy of your work at STARS@ucf.edu

Abbreviated Journal Title

Hum. Factors

Keywords

mental workload; dual-task performance; psychometrics; psychophysiology; neuroergonomics; TRANSCRANIAL DOPPLER ULTRASONOGRAPHY; SUSTAINED ATTENTION; SUBJECTIVE; MEASURES; HEART-RATE; EEG; PERFORMANCE; RESOURCES; CLASSIFICATION; VARIABILITY; VIGILANCE; Behavioral Sciences; Engineering, Industrial; Ergonomics; Psychology, ; Applied; Psychology

Abstract

Objective: A study was run to test the sensitivity of multiple workload indices to the differing cognitive demands of four military monitoring task scenarios and to investigate relationships between indices. Background: Various psychophysiological indices of mental workload exhibit sensitivity to task factors. However, the psychometric properties of multiple indices, including the extent to which they intercorrelate, have not been adequately investigated. Method: One hundred fifty participants performed in four task scenarios based on a simulation of unmanned ground vehicle operation. Scenarios required threat detection and/or change detection. Both single- and dual-task scenarios were used. Workload metrics for each scenario were derived from the electroencephalogram (EEG), electrocardiogram, transcranial Doppler sonography, functional near infrared, and eye tracking. Subjective workload was also assessed. Results: Several metrics showed sensitivity to the differing demands of the four scenarios. Eye fixation duration and the Task Load Index metric derived from EEG were diagnostic of single-versus dual-task performance. Several other metrics differentiated the two single tasks but were less effective in differentiating single- from dual-task performance. Psychometric analyses confirmed the reliability of individual metrics but failed to identify any general workload factor. An analysis of difference scores between low- and high-workload conditions suggested an effort factor defined by heart rate variability and frontal cortex oxygenation. Conclusions: General workload is not well defined psychometrically, although various individual metrics may satisfy conventional criteria for workload assessment. Application: Practitioners should exercise caution in using multiple metrics that may not correspond well, especially at the level of the individual operator.

Journal Title

Human Factors

Volume

57

Issue/Number

1

Publication Date

1-1-2015

Document Type

Article

Language

English

First Page

125

Last Page

143

WOS Identifier

WOS:000349533800008

ISSN

0018-7208

Share

COinS