Mistake Captioning: A Machine Learning Approach for Detecting Mistakes and Generating Instructive Feedback
Giving feedback to students is not just about marking their answers as correct or incorrect, but also finding mistakes in their thought process that led them to that incorrect answer. In this paper, we introduce a machine learning technique for mistake captioning, a task that attempts to identify mistakes and provide feedback meant to help learners correct these mistakes. We do this by training a sequence-to-sequence network to generate this feedback based on domain experts. To evaluate this system, we explore how it can be used on a Linguistics assignment studying Grimm’s Law. We show that our approach generates feedback that outperforms a baseline on a set of automated NLP metrics. In addition, we perform a series of case studies in which we examine successful and unsuccessful system outputs.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
A Deep Dive Into Large Language Model Code Generation Mistakes: What and Why?
Recent advancements in Large Language Models (LLMs) have led to their widespread application in automated code generation. However, these models can still generate defective code that deviates from the specification. Pre…
Code GenerationLanguage ModelingLanguage ModellingLarge Language ModelEgoOops: A Dataset for Mistake Action Detection from Egocentric Videos with Procedural Texts
Mistake action detection from egocentric videos is crucial for developing intelligent archives that detect workers' errors and provide feedback. Previous studies have been limited to specific domains, focused on detectin…
Action DetectionMistake DetectionLearning from Mistakes -- A Framework for Neural Architecture Search
Learning from one's mistakes is an effective human learning technique where the learners focus more on the topics where mistakes were made, so as to deepen their understanding. In this paper, we investigate if this human…
BIG-bench Machine LearningNeural Architecture SearchHow do you correct run-on sentences it's not as easy as it seems
Run-on sentences are common grammatical mistakes but little research has tackled this problem to date. This work introduces two machine learning models to correct run-on sentences that outperform leading methods for rela…
BIG-bench Machine LearningGrammatical Error CorrectionPunctuation RestorationSentenceEvery Mistake Counts in Assembly
One promising use case of AI assistants is to help with complex procedures like cooking, home repair, and assembly tasks. Can we teach the assistant to interject after the user makes a mistake? This paper targets the pro…