GraderGPT: Making GenAI Help Humans Grade Better
Location
Seminole E
Start Date
23-7-2024 11:30 AM
End Date
23-7-2024 11:55 AM
Description
Generative Artificial Intelligence (GenAI) tools, such as OpenAI’s ChatGPT and Google’s Bard, have opened up a new avenue of questions, applications, and risks in the education space. Acknowledging the benefits of using such tools to assist educators, we present GraderGPT, a GenAI-based system that aims to assist in the grading quality for writing assignments in large courses with multiple graders. GraderGPT does not replace human graders but instead supports them as a powerful tool to limit scoring variance. Using two different courses as part of our initial study, preliminary feedback indicates the utility of not just identifying scoring variances, but also improving the quality of grading criteria to have better clarity and instruction. This research suggests the potential of GraderGPT as an effective GenAI grading assistant and contributes to the broader conversation about the role of GenAI in education.
Recommended Citation
Qian, Zhen; Bodary, Peter E.; and King, Julianna F., "GraderGPT: Making GenAI Help Humans Grade Better" (2024). Teaching and Learning with AI Conference Presentations. 48.
https://stars.library.ucf.edu/teachwithai/2024/tuesday/48
GraderGPT: Making GenAI Help Humans Grade Better
Seminole E
Generative Artificial Intelligence (GenAI) tools, such as OpenAI’s ChatGPT and Google’s Bard, have opened up a new avenue of questions, applications, and risks in the education space. Acknowledging the benefits of using such tools to assist educators, we present GraderGPT, a GenAI-based system that aims to assist in the grading quality for writing assignments in large courses with multiple graders. GraderGPT does not replace human graders but instead supports them as a powerful tool to limit scoring variance. Using two different courses as part of our initial study, preliminary feedback indicates the utility of not just identifying scoring variances, but also improving the quality of grading criteria to have better clarity and instruction. This research suggests the potential of GraderGPT as an effective GenAI grading assistant and contributes to the broader conversation about the role of GenAI in education.