paper-with-me

Papers

Forgetting-aware Linear Bias for Attentive Knowledge Tracing

2023-09-26 · Yoonjin Im, Eunseong Choi, Heejin Kook, Jongwuk Lee

Knowledge Tracing (KT) aims to track proficiency based on a question-solving history, allowing us to offer a streamlined curriculum. Recent studies actively utilize attention-based mechanisms to capture the correlation between questions and combine it with the learner's characteristics for responses. However, our empirical study shows that existing attention-based KT models neglect the learner's forgetting behavior, especially as the interaction history becomes longer. This problem arises from the bias that overprioritizes the correlation of questions while inadvertently ignoring the impact of forgetting behavior. This paper proposes a simple-yet-effective solution, namely Forgetting-aware Linear Bias (FoLiBi), to reflect forgetting behavior as a linear bias. Despite its simplicity, FoLiBi is readily equipped with existing attentive KT models by effectively decomposing question correlations with forgetting behavior. FoLiBi plugged with several KT models yields a consistent improvement of up to 2.58% in AUC over state-of-the-art KT models on four benchmark datasets.

📄 PDF Abstract BibTeX arXiv:2309.14796

Code (1)

skewondr/FoLiBi 공식 구현 pytorch

Tasks

Knowledge Tracing

Similar Papers 제목 키워드 기반

AC-MASAC: An Attentive Curriculum Learning Framework for Heterogeneous UAV Swarm Coordination

2026-02-12 · Wanhao Liu, Junhong Dai, Yixuan Zhang, Shengyun Yin 외 arxiv

Cooperative path planning for heterogeneous UAV swarms poses significant challenges for Multi-Agent Reinforcement Learning (MARL), particularly in handling asymmetric inter-agent dependencies and addressing the risks of …

Multi-agent Reinforcement Learning

Continual Attentive Fusion for Incremental Learning in Semantic Segmentation

2022-02-01 · Guanglei Yang, Enrico Fini, Dan Xu, Paolo Rota 외

Over the past years, semantic segmentation, as many other tasks in computer vision, benefited from the progress in deep neural networks, resulting in significantly improved performance. However, deep architectures traine…

Incremental LearningSemantic Segmentation

Context-aware Non-linear and Neural Attentive Knowledge-based Models for Grade Prediction

2020-03-09 · Sara Morsy, George Karypis

Grade prediction for future courses not yet taken by students is important as it can help them and their advisers during the process of course selection as well as for designing personalized degree plans and modifying th…

Convergence and Implicit Bias of Gradient Descent on Continual Linear Classification

2025-04-17 · Hyunji Jung, Hanseul Cho, Chulhee Yun

We study continual learning on multiple linear classification tasks by sequentially running gradient descent (GD) for a fixed budget of iterations per task. When all tasks are jointly linearly separable and are presented…

Continual LearningTransfer Learning

TAAM:Inductive Graph-Class Incremental Learning with Task-Aware Adaptive Modulation

2026-02-08 · Jingtao Liu, Xinming Zhang arxiv

Graph Continual Learning (GCL) aims to solve the challenges of streaming graph data. However, current methods often depend on replay-based strategies, which raise concerns like memory limits and privacy issues, while als…

Class Incremental LearningContinual Learning