$β^3$-IRT: A New Item Response Model and its Applications
Item Response Theory (IRT) aims to assess latent abilities of respondents based on the correctness of their answers in aptitude test items with different difficulty levels. In this paper, we propose the $\beta^3$-IRT model, which models continuous responses and can generate a much enriched family of Item Characteristic Curve (ICC). In experiments we applied the proposed model to data from an online exam platform, and show our model outperforms a more standard 2PL-ND model on all datasets. Furthermore, we show how to apply $\beta^3$-IRT to assess the ability of machine learning classifiers. This novel application results in a new metric for evaluating the quality of the classifier's probability estimates, based on the inferred difficulty and discrimination of data instances.
Code (1)
Similar Papers 제목 키워드 기반
Amortised Design Optimization for Item Response Theory
Item Response Theory (IRT) is a well known method for assessing responses from humans in education and psychology. In education, IRT is used to infer student abilities and characteristics of test items from student respo…
Deep Reinforcement LearningExperimental DesignUsing Item Response Theory to Measure Gender and Racial Bias of a BERT-based Automated English Speech Assessment System
Recent advances in natural language processing and transformer-based models have made it easier to implement accurate, automated English speech assessments. Yet, without careful examination, applications of these models …
PSO-based Fuzzy Markup Language for Student Learning Performance Evaluation and Educational Application
This paper proposes an agent with particle swarm optimization (PSO) based on a Fuzzy Markup Language (FML) for students learning performance evaluation and educational applications, and the proposed agent is according to…
parameter estimationA Spectral Approach to Item Response Theory
The Rasch model is one of the most fundamental models in \emph{item response theory} and has wide-ranging applications from education testing to recommendation systems. In a universe with $n$ users and $m$ items, the Ras…
Recommendation SystemsLearning with linear mixed model for group recommendation systems
Accurate prediction of users' responses to items is one of the main aims of many computational advising applications. Examples include recommending movies, news articles, songs, jobs, clothes, books and so forth. Accurat…
ArticlesRecommendation Systems