paper-with-me

홈 › Papers

BOBCAT: Bilevel Optimization-Based Computerized Adaptive Testing

2021-08-17 · Aritra Ghosh, Andrew Lan

Computerized adaptive testing (CAT) refers to a form of tests that are personalized to every student/test taker. CAT methods adaptively select the next most informative question/item for each student given their responses to previous questions, effectively reducing test length. Existing CAT methods use item response theory (IRT) models to relate student ability to their responses to questions and static question selection algorithms designed to reduce the ability estimation error as quickly as possible; therefore, these algorithms cannot improve by learning from large-scale student response data. In this paper, we propose BOBCAT, a Bilevel Optimization-Based framework for CAT to directly learn a data-driven question selection algorithm from training data. BOBCAT is agnostic to the underlying student response model and is computationally efficient during the adaptive testing process. Through extensive experiments on five real-world student response datasets, we show that BOBCAT outperforms existing CAT methods (sometimes significantly) at reducing test length.

📄 PDF Abstract BibTeX arXiv:2108.07386

Code (2)

arghosh/bobcat 공식 구현 pytorch
arghosh/NeurIPSEducation2020 pytorch

Tasks

Bilevel OptimizationQuestion Selection

Similar Papers 제목 키워드 기반

Balancing Test Accuracy and Security in Computerized Adaptive Testing

2023-05-18 · Wanyong Feng, Aritra Ghosh, Stephen Sireci, Andrew S. Lan

Computerized adaptive testing (CAT) is a form of personalized testing that accurately measures students' knowledge levels while reducing test length. Bilevel optimization-based CAT (BOBCAT) is a recent framework that lea…

Bilevel OptimizationQuestion Selection

CodeGENCAT: Generative Computerized Adaptive Testing for Open-ended Coding Problems

2026-02-23 · Wanyong Feng, Alexander Scarlatos, Ruochen Sun, Andrew Lan arxiv

Existing Computerized Adaptive Testing (CAT) frameworks typically select questions based on the predicted likelihood that the student will answer correctly. This design ignores information contained in students' open-end…

BiAdam: Fast Adaptive Bilevel Optimization Methods

2021-06-21 · Feihu Huang, Junyi Li, Shangqian Gao

Bilevel optimization recently has attracted increased interest in machine learning due to its many applications such as hyper-parameter optimization and meta learning. Although many bilevel methods recently have been pro…

Bilevel OptimizationMeta-LearningRepresentation Learning

Survey of Computerized Adaptive Testing: A Machine Learning Perspective

2024-03-31 · Qi Liu, Yan Zhuang, Haoyang Bi, Zhenya Huang 외

Computerized Adaptive Testing (CAT) provides an efficient and tailored method for assessing the proficiency of examinees, by dynamically adjusting test questions based on their performance. Widely adopted across diverse …

cognitive diagnosisQuestion SelectionSociologySurvey

An Intelligent Testing Strategy for Vocabulary Assessment of Chinese Second Language Learners

2019-08-01 · WS 2019 8 · Wei Zhou, Renfen Hu, Feipeng Sun, Ronghuai Huang

Vocabulary is one of the most important parts of language competence. Testing of vocabulary knowledge is central to research on reading and language. However, it usually costs a large amount of time and human labor to bu…