Not All Options Are Created Equal: Textual Option Weighting for Token-Efficient LLM-Based Knowledge Tracing
Large Language Models (LLMs) have recently emerged as promising tools for knowledge tracing (KT) due to their strong reasoning and generalization abilities. While recent LLM-based KT methods have proposed new prompt formats, they struggle to represent the full interaction histories of example learners within a single prompt during in-context learning (ICL), resulting in limited scalability and high computational cost under token constraints. In this work, we present \textit{LLM-based Option-weighted Knowledge Tracing (LOKT)}, a simple yet effective framework that encodes the interaction histories of example learners in context as \textit{textual categorical option weights (TCOW)}. TCOW are semantic labels (e.g., ``inadequate'') assigned to the options selected by learners when answering questions, enhancing the interpretability of LLMs. Experiments on multiple-choice datasets show that LOKT outperforms existing non-LLM and LLM-based KT models in both cold-start and warm-start settings. Moreover, LOKT enables scalable and cost-efficient inference, achieving strong performance even under strict token constraints. Our code is available at \href{https://anonymous.4open.science/r/LOKT_model-3233}{https://anonymous.4open.science/r/LOKT\_model-3233}.
Code (0)
등록된 구현이 없습니다.
Tasks
AllBinary ClassificationIn-Context LearningKnowledge TracingLanguage ModelingLanguage ModellingLarge Language ModelMultiple-choiceSimilar Papers 제목 키워드 기반
Corpus Prevalence of Multiple-Choice Question Options
In recent years, corpus-driven AI methods, such as Large Language Models (LLMs), have seen widespread use in education. While on the surface their abilities look promising for tasks ranging from generating assessment mat…
The Black-Scholes-Merton dual equation
We derive the Black-Scholes-Merton dual equation, which has exactly the same form as the Black-Scholes-Merton equation. The novel and general equation works for options with a payoff of homogeneous of degree one, includi…
Pricing American Call Options by the Black-Scholes Equation with a Nonlinear Volatility Function
In this paper we investigate a nonlinear generalization of the Black-Scholes equation for pricing American style call options in which the volatility term may depend on the underlying asset price and the Gamma of the opt…
Beyond the Textual: Generating Coherent Visual Options for MCQs
Multiple-choice questions (MCQs) play a crucial role in fostering deep thinking and knowledge integration in education. However, previous research has primarily focused on generating MCQs with textual options, but it lar…
Question GenerationPOE: Process of Elimination for Multiple Choice Reasoning
Language models (LMs) are capable of conducting in-context learning for multiple choice reasoning tasks, but the options in these tasks are treated equally. As humans often first eliminate wrong options before picking th…
In-Context LearningLogical ReasoningMultiple-choice