A Workflow For Network Analysis-Based Structure Discovery In The Assessment Community
Keywords
Assessment; Data extraction; Network analysis; Standardization; Structure discovery
Abstract
When technology opens up new domains or areas of research, such as human-agent teaming, new challenges in assessments emerge. Assessments may not be as systematically conducted as new measures develop, and the research may not be as firmly grounded in theory since theories in newer domains are still being formulated. As a result, research in these domains can be fragmented. To address these, an empirically-driven network approach that is complementary to the traditional theory-driven approach is proposed. The network approach seeks to discover patterns and structure in the assessment metadata (.e.g., constructs and measures) that can provide starting points and direction for future research. This paper outlines the workflow of the network approach which comprises three steps: (1) Data Preparation; (2) Data Analysis; and (3) Structure Discovery. As most of the work has been on Data Preparation, the paper will focus on the complexities and issues encountered in the first step, and include broad overviews of the subsequent steps. Anticipated use and outcomes of the network approach are also discussed.
Publication Date
1-1-2018
Publication Title
Lecture Notes in Computer Science (including subseries Lecture Notes in Artificial Intelligence and Lecture Notes in Bioinformatics)
Volume
10915 LNAI
Number of Pages
341-352
Document Type
Article; Proceedings Paper
Personal Identifier
scopus
DOI Link
https://doi.org/10.1007/978-3-319-91470-1_28
Copyright Status
Unknown
Socpus ID
85050619012 (Scopus)
Source API URL
https://api.elsevier.com/content/abstract/scopus_id/85050619012
STARS Citation
Teo, Grace; Reinerman-Jones, Lauren; Riecken, Mark E.; McDonnell, Joseph; and Gallant, Scott, "A Workflow For Network Analysis-Based Structure Discovery In The Assessment Community" (2018). Scopus Export 2015-2019. 10038.
https://stars.library.ucf.edu/scopus2015/10038