Title

A Comparative Assessment And Gap Analysis Of Commonly Used Team Rating Scales

Keywords

Medical education; Patient safety; Performance assessment; Rating scale; Taskwork; Teamwork

Abstract

Background The purpose of this article was to conduct a gap analysis of important team constructs that may be absent in widely used team assessments. Methods and materials Two assessment tools with known validity evidence (1) Non-Technical Skills for Surgeons (NOTSS) and (2) the Cannon-Bowers Scale were used to evaluate 11 teams of surgical residents (n = 33) performing simulated laparoscopic hernia repairs. Faculty raters' scores were used to compare the surveys and assess validity and reliability. Raters' detailed observation notes were used to indicate important behavioral constructs that were missing from the team rating scales. Results When assessing inter-item correlations (reliability) four of five NOTSS' scale items had significant correlations (r = 0.9-1.0, P < 0.05) with the Cannon-Bowers items. While the correlations were only noted for three of six Cannon-Bowers items, in each instance the same four of five NOTSS items correlated with the three Cannon-Bowers items, thus providing further validity evidence for both scales. When evaluating the gap, key emerging themes included the need to focus on critical team errors, individual team member contributions, task performance, and overall team performance. These gaps, plus items from the NOTSS and Cannon-Bowers scales, were incorporated into a new rating scale. Conclusions Despite continued evidence of validity and reliability, there were several behavioral constructs that were not represented when using the NOTSS and Cannon-Bowers scales. Critical team errors, individual team member contributions, task performance, and overall team performance appear important in our ability to understand teams and teamwork. © 2014 Elsevier Inc. All rights reserved.

Publication Date

1-1-2014

Publication Title

Journal of Surgical Research

Volume

190

Issue

2

Number of Pages

445-450

Document Type

Article

Personal Identifier

scopus

DOI Link

https://doi.org/10.1016/j.jss.2014.04.034

Socpus ID

84904268124 (Scopus)

Source API URL

https://api.elsevier.com/content/abstract/scopus_id/84904268124

This document is currently not available here.

Share

COinS