McMining: Automated Discovery of Misconceptions in Student Code
When learning to code, students often develop misconceptions about various programming language concepts. These can not only lead to bugs or inefficient code, but also slow down the learning of related concepts. In this paper, we introduce McMining, the task of mining programming misconceptions from samples of code from a student. To enable the training and evaluation of McMining systems, we develop an extensible benchmark dataset of misconceptions together with a large set of code samples where these misconceptions are manifested. We then introduce two LLM-based McMiner approaches and through extensive evaluations show that models from the Gemini, Claude, and GPT families are effective at discovering misconceptions in student code.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Toward Semi-Automatic Misconception Discovery Using Code Embeddings
Understanding students' misconceptions is important for effective teaching and assessment. However, discovering such misconceptions manually can be time-consuming and laborious. Automated misconception discovery can addr…
Code ClassificationMisconceptionsThe Correct Answer Trap: Pedagogically-Grounded Detection and Feedback for Hidden Misconceptions
Automated feedback systems that rely on answer correctness will reinforce, rather than address, misconceptions when students reach the correct answer through flawed reasoning. We investigate automatic detection of these …
Automated Identification of Logical Errors in Programs: Advancing Scalable Analysis of Student Misconceptions
In Computer Science (CS) education, understanding factors contributing to students' programming difficulties is crucial for effective learning support. By identifying specific issues students face, educators can provide …
MisconceptionsLearning to Make MISTAKEs: Modeling Incorrect Student Thinking And Key Errors
Research on reasoning in language models (LMs) predominantly focuses on improving the correctness of their outputs. But some important applications require modeling reasoning patterns that are incorrect. For example, aut…
Answer GenerationData-Mining Textual Responses to Uncover Misconception Patterns
An important, yet largely unstudied, problem in student data analysis is to detect misconceptions from students' responses to open-response questions. Misconception detection enables instructors to deliver more targeted …
Misconceptions