SINKT: A Structure-Aware Inductive Knowledge Tracing Model with Large Language Model
Knowledge Tracing (KT) aims to determine whether students will respond correctly to the next question, which is a crucial task in intelligent tutoring systems (ITS). In educational KT scenarios, transductive ID-based methods often face severe data sparsity and cold start problems, where interactions between individual students and questions are sparse, and new questions and concepts consistently arrive in the database. In addition, existing KT models only implicitly consider the correlation between concepts and questions, lacking direct modeling of the more complex relationships in the heterogeneous graph of concepts and questions. In this paper, we propose a Structure-aware Inductive Knowledge Tracing model with large language model (dubbed SINKT), which, for the first time, introduces large language models (LLMs) and realizes inductive knowledge tracing. Firstly, SINKT utilizes LLMs to introduce structural relationships between concepts and constructs a heterogeneous graph for concepts and questions. Secondly, by encoding concepts and questions with LLMs, SINKT incorporates semantic information to aid prediction. Finally, SINKT predicts the student's response to the target question by interacting with the student's knowledge state and the question representation. Experiments on four real-world datasets demonstrate that SINKT achieves state-of-the-art performance among 12 existing transductive KT models. Additionally, we explore the performance of SINKT on the inductive KT task and provide insights into various modules.
Code (1)
Tasks
Knowledge TracingLanguage ModelingLanguage ModellingLarge Language ModelmodelSimilar Papers 제목 키워드 기반
Graph-based Knowledge Tracing: Modeling Student Proficiency Using Graph Neural Network
Recent advancements in computer-assisted learning systems have caused an increase in the research of knowledge tracing, wherein student performance on coursework exercises is predicted over time. From the viewpoint of da…
Graph Neural NetworkInductive BiasKnowledge TracingTime Series+1SinkTrack: Attention Sink based Context Anchoring for Large Language Models
Large language models (LLMs) suffer from hallucination and context forgetting. Prior studies suggest that attention drift is a primary cause of these problems, where LLMs' focus shifts towards newly generated tokens and …
Accuracy-aware Deep Knowledge Tracing with Knowledge State Vector Loss
In major e-learning platforms such as intelligent tutoring systems (ITSs) and massive open online courses (MOOCs), the students are often recommended what course materials to take based on their past interactions. Knowle…
Knowledge TracingTopology-Aware Correlations Between Relations for Inductive Link Prediction in Knowledge Graphs
Inductive link prediction -- where entities during training and inference stages can be different -- has been shown to be promising for completing continuously evolving knowledge graphs. Existing models of inductive reas…
Inductive Link PredictionKnowledge GraphsLink PredictionPrediction+1SA-MLP: Distilling Graph Knowledge from GNNs into Structure-Aware MLP
The message-passing mechanism helps Graph Neural Networks (GNNs) achieve remarkable results on various node classification tasks. Nevertheless, the recursive nodes fetching and aggregation in message-passing cause infere…
Knowledge DistillationNode Classification