Option Tracing: Beyond Correctness Analysis in Knowledge Tracing
Knowledge tracing refers to a family of methods that estimate each student's knowledge component/skill mastery level from their past responses to questions. One key limitation of most existing knowledge tracing methods is that they can only estimate an \emph{overall} knowledge level of a student per knowledge component/skill since they analyze only the (usually binary-valued) correctness of student responses. Therefore, it is hard to use them to diagnose specific student errors. In this paper, we extend existing knowledge tracing methods beyond correctness prediction to the task of predicting the exact option students select in multiple choice questions. We quantitatively evaluate the performance of our option tracing methods on two large-scale student response datasets. We also qualitatively evaluate their ability in identifying common student errors in the form of clusters of incorrect options across different questions that correspond to the same error.
Code (2)
Tasks
Knowledge TracingMultiple-choiceSkill MasterySimilar Papers 제목 키워드 기반
Option Tracing: Beyond Binary Knowledge Tracing
This paper details our solutions to Tasks 1&2 of the NeurIPS 2020 Education Challenge.1 Knowledge tracing, a family of methods to estimate each student’s mastery levels on skills/knowledge components from their past res…
Knowledge TracingMultiple-choicePredictionNo Task Left Behind: Multi-Task Learning of Knowledge Tracing and Option Tracing for Better Student Assessment
Student assessment is one of the most fundamental tasks in the field of AI Education (AIEd). One of the most common approach to student assessment is Knowledge Tracing (KT), which evaluates a student's knowledge state by…
Knowledge TracingMultiple-choiceMulti-Task LearningExtending Deep Knowledge Tracing: Inferring Interpretable Knowledge and Predicting Post-System Performance
Recent student knowledge modeling algorithms such as Deep Knowledge Tracing (DKT) and Dynamic Key-Value Memory Networks (DKVMN) have been shown to produce accurate predictions of problem correctness within the same learn…
Knowledge TracingGPT-based Open-Ended Knowledge Tracing
In education applications, knowledge tracing refers to the problem of estimating students' time-varying concept/skill mastery level from their past responses to questions and predicting their future performance. One key …
Code GenerationKnowledge TracingNavigateProgram Synthesis+1Enhancing Knowledge Tracing with Concept Map and Response Disentanglement
In the rapidly advancing realm of educational technology, it becomes critical to accurately trace and understand student knowledge states. Conventional Knowledge Tracing (KT) models have mainly focused on binary response…
DisentanglementKnowledge TracingMisconceptionsMultiple-choice