Investigating the Robustness of Knowledge Tracing Models in the Presence of Student Concept Drift
Knowledge Tracing (KT) has been an established problem in the educational data mining field for decades, and it is commonly assumed that the underlying learning process being modeled remains static. Given the ever-changing landscape of online learning platforms (OLPs), we investigate how concept drift and changing student populations can impact student behavior within an OLP through testing model performance both within a single academic year and across multiple academic years. Four well-studied KT models were applied to five academic years of data to assess how susceptible KT models are to concept drift. Through our analysis, we find that all four families of KT models can exhibit degraded performance, Bayesian Knowledge Tracing (BKT) remains the most stable KT model when applied to newer data, while more complex, attention based models lose predictive power significantly faster.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge TracingSimilar Papers 제목 키워드 기반
Dynamic Knowledge embedding and tracing
The goal of knowledge tracing is to track the state of a student's knowledge as it evolves over time. This plays a fundamental role in understanding the learning process and is a key task in the development of an intelli…
Knowledge TracingTAGUncertainty-aware Knowledge Tracing
Knowledge Tracing (KT) is crucial in education assessment, which focuses on depicting students' learning states and assessing students' mastery of subjects. With the rise of modern online learning platforms, particularly…
Contrastive LearningKnowledge TracingFrom Prediction to Application: Language Model-based Code Knowledge Tracing with Domain Adaptive Pre-Training and Automatic Feedback System with Pedagogical Prompting for Comprehensive Programming Education
Knowledge Tracing (KT) is a critical component in online learning, but traditional approaches face limitations in interpretability and cross-domain adaptability. This paper introduces Language Model-based Code Knowledge …
Knowledge TracingLanguage ModelingLanguage ModellingHD-KT: Advancing Robust Knowledge Tracing via Anomalous Learning Interaction Detection
Knowledge tracing (KT) is a crucial task in online learning, aimed at tracing and predicting each student's knowledge states throughout their learning process. Over the past decade, it has garnered widespread attention d…
DenoisingKnowledge TracingDeep Knowledge Tracing and Dynamic Student Classification for Knowledge Tracing
In Intelligent Tutoring System (ITS), tracing the student's knowledge state during learning has been studied for several decades in order to provide more supportive learning instructions. In this paper, we propose a nove…
ClassificationGeneral ClassificationKnowledge Tracing