paper-with-me

홈 › Papers

Automatic Feedback Generation for Short Answer Questions using Answer Diagnostic Graphs

2025-01-27 · Momoka Furuhashi, Hiroaki Funayama, Yuya Iwase, Yuichiroh Matsubayashi, Yoriko Isobe, Toru Nagahama, Saku Sugawara, Kentaro Inui

Short-reading comprehension questions help students understand text structure but lack effective feedback. Students struggle to identify and correct errors, while manual feedback creation is labor-intensive. This highlights the need for automated feedback linking responses to a scoring rubric for deeper comprehension. Despite advances in Natural Language Processing (NLP), research has focused on automatic grading, with limited work on feedback generation. To address this, we propose a system that generates feedback for student responses. Our contributions are twofold. First, we introduce the first system for feedback on short-answer reading comprehension. These answers are derived from the text, requiring structural understanding. We propose an "answer diagnosis graph," integrating the text's logical structure with feedback templates. Using this graph and NLP techniques, we estimate students' comprehension and generate targeted feedback. Second, we evaluate our feedback through an experiment with Japanese high school students (n=39). They answered two 70-80 word questions and were divided into two groups with minimal academic differences. One received a model answer, the other system-generated feedback. Both re-answered the questions, and we compared score changes. A questionnaire assessed perceptions and motivation. Results showed no significant score improvement between groups, but system-generated feedback helped students identify errors and key points in the text. It also significantly increased motivation. However, further refinement is needed to enhance text structure understanding.

📄 PDF Abstract BibTeX arXiv:2501.15777

Code (0)

등록된 구현이 없습니다.

Tasks

DiagnosticReading Comprehension

Similar Papers 제목 키워드 기반

"I understand why I got this grade": Automatic Short Answer Grading with Feedback

2024-06-30 · Dishank Aggarwal, Pritam Sil, Bhaskaran Raman, Pushpak Bhattacharyya

In recent years, there has been a growing interest in using Artificial Intelligence (AI) to automate student assessment in education. Among different types of assessments, summative assessments play a crucial role in eva…

automatic short answer grading

Beyond Scores: A Modular RAG-Based System for Automatic Short Answer Scoring with Feedback

2024-09-30 · Menna Fateen, Bo wang, Tsunenori Mine

Automatic short answer scoring (ASAS) helps reduce the grading burden on educators but often lacks detailed, explainable feedback. Existing methods in ASAS with feedback (ASAS-F) rely on fine-tuning language models with …

Few-Shot LearningPrompt EngineeringRAGRetrieval-augmented Generation

Your Answer is Incorrect... Would you like to know why? Introducing a Bilingual Short Answer Feedback Dataset

2022-05-01 · ACL 2022 5 · Anna Filighera, Siddharth Parihar, Tim Steuer, Tobias Meuser 외

Handing in a paper or exercise and merely receiving “bad” or “incorrect” as feedback is not very helpful when the goal is to improve. Unfortunately, this is currently the kind of feedback given by Automatic Short Answer …

automatic short answer grading

Your Answer is Incorrect... Would you like to know why? Introducing a Bilingual Short Answer Feedback Dataset

2021-12-17 · ACL ARR December 2022 12 · Anonymous

Handing in a paper or exercise and merely receiving a "bad" or "incorrect" as feedback is not very helpful when the goal is to improve. Unfortunately, this is currently the kind of feedback given by many Automatic Short …

automatic short answer grading

Few-shot Question Generation for Personalized Feedback in Intelligent Tutoring Systems

2022-06-08 · Devang Kulshreshtha, Muhammad Shayan, Robert Belfer, Siva Reddy 외

Existing work on generating hints in Intelligent Tutoring Systems (ITS) focuses mostly on manual and non-personalized feedback. In this work, we explore automatically generated questions as personalized feedback in an IT…

Generative Question AnsweringQuestion AnsweringQuestion GenerationQuestion-Generation+2