paper-with-me

홈 › Papers

HiTSKT: A Hierarchical Transformer Model for Session-Aware Knowledge Tracing

2022-12-23 · Fucai Ke, Weiqing Wang, Weicong Tan, Lan Du, Yuan Jin, Yujin Huang, Hongzhi Yin

Knowledge tracing (KT) aims to leverage students' learning histories to estimate their mastery levels on a set of pre-defined skills, based on which the corresponding future performance can be accurately predicted. As an important way of providing personalized experience for online education, KT has gained increased attention in recent years. In practice, a student's learning history comprises answers to sets of massed questions, each known as a session, rather than merely being a sequence of independent answers. Theoretically, within and across these sessions, students' learning dynamics can be very different. Therefore, how to effectively model the dynamics of students' knowledge states within and across the sessions is crucial for handling the KT problem. Most existing KT models treat student's learning records as a single continuing sequence, without capturing the sessional shift of students' knowledge state. To address the above issue, we propose a novel hierarchical transformer model, named HiTSKT, comprises an interaction(-level) encoder to capture the knowledge a student acquires within a session, and a session(-level) encoder to summarise acquired knowledge across the past sessions. To predict an interaction in the current session, a knowledge retriever integrates the summarised past-session knowledge with the previous interactions' information into proper knowledge representations. These representations are then used to compute the student's current knowledge state. Additionally, to model the student's long-term forgetting behaviour across the sessions, a power-law-decay attention mechanism is designed and deployed in the session encoder, allowing it to emphasize more on the recent sessions. Extensive experiments on three public datasets demonstrate that HiTSKT achieves new state-of-the-art performance on all the datasets compared with six state-of-the-art KT models.

📄 PDF Abstract BibTeX arXiv:2212.12139

Code (1)

pokerme7777/hitskt 공식 구현 pytorch

Tasks

Knowledge Tracing

Similar Papers 제목 키워드 기반

FlatFormer: A Flat Transformer Knowledge Tracing Model Based on Cognitive Bias Injection

2025-12-07 · Xiao-li Xia, Hou-biao Li arxiv

Knowledge Tracing (KT) models face a critical ``Performance-Complexity Trap'': capturing complex cognitive dynamics like learning sessions and memory decay typically requires deep hierarchical architectures, which incur …

Knowledge Tracing

History-Aware Hierarchical Transformer for Multi-session Open-domain Dialogue System

2023-02-02 · Tong Zhang, Yong liu, Boyang Li, Zhiwei Zeng 외

With the evolution of pre-trained language models, current open-domain dialogue systems have achieved great progress in conducting one-session conversations. In contrast, Multi-Session Conversation (MSC), which consists …

Hierarchical Multi-Task Learning Framework for Session-based Recommendations

2023-09-12 · Sejoon Oh, Walid Shalaby, Amir Afsharinejad, Xiquan Cui

While session-based recommender systems (SBRSs) have shown superior recommendation performance, multi-task learning (MTL) has been adopted by SBRSs to enhance their prediction accuracy and generalizability further. Hiera…

Multi-Task LearningPredictionRecommendation SystemsSession-Based Recommendations

Knowledge-enhanced Session-based Recommendation with Temporal Transformer

2021-12-16 · Rongzhi Zhang, Yulong Gu, Xiaoyu Shen, Hui Su

Recent research has achieved impressive progress in the session-based recommendation. However, information such as item knowledge and click time interval, which could be potentially utilized to improve the performance, r…

Graph Representation LearningRepresentation LearningSession-Based Recommendations

Session-aware Item-combination Recommendation with Transformer Network

2021-11-13 · Tzu-Heng Lin, Chen Gao

In this paper, we detailedly describe our solution for the IEEE BigData Cup 2021: RL-based RecSys (Track 1: Item Combination Prediction). We first conduct an exploratory data analysis on the dataset and then utilize the …

Prediction