Concurrent Session #9: Successfully Identifying AI Submissions for Short-Essay Exam Questions
Location
Cape Florida A
Start Date
25-9-2023 2:45 PM
End Date
25-9-2023 3:00 PM
Description
Artificial Intelligence (AI) tools such as ChatGPT can easily produce short essay responses to the prompts used in exam questions. To determine whether the AI responses could be successfully identified, 25 actual student responses to an exam question were combined with an equal number of responses generated by ChatGPT and evaluated by both a human instructor and the GPTZero tool. The GPTZero tool computes metrics on the word use in text which it uses to determine whether the text was generated entirely by a human, entirely by an AI, or by a human with AI help.
Recommended Citation
Gilbrook, MIchael, "Concurrent Session #9: Successfully Identifying AI Submissions for Short-Essay Exam Questions" (2023). Teaching and Learning with AI Conference Presentations. 63.
https://stars.library.ucf.edu/teachwithai/2023/monday/63
Concurrent Session #9: Successfully Identifying AI Submissions for Short-Essay Exam Questions
Cape Florida A
Artificial Intelligence (AI) tools such as ChatGPT can easily produce short essay responses to the prompts used in exam questions. To determine whether the AI responses could be successfully identified, 25 actual student responses to an exam question were combined with an equal number of responses generated by ChatGPT and evaluated by both a human instructor and the GPTZero tool. The GPTZero tool computes metrics on the word use in text which it uses to determine whether the text was generated entirely by a human, entirely by an AI, or by a human with AI help.