Distractor Generation for Multiple Choice Questions Using Learning to Rank
We investigate how machine learning models, specifically ranking models, can be used to select useful distractors for multiple choice questions. Our proposed models can learn to select distractors that resemble those in actual exam questions, which is different from most existing unsupervised ontology-based and similarity-based methods. We empirically study feature-based and neural net (NN) based ranking models with experiments on the recently released SciQ dataset and our MCQL dataset. Experimental results show that feature-based ensemble learning methods (random forest and LambdaMART) outperform both the NN-based method and unsupervised baselines. These two datasets can also be used as benchmarks for distractor generation.
Code (1)
Tasks
BIG-bench Machine LearningDistractor GenerationEnsemble LearningLearning-To-RankMultiple-choiceSimilar Papers 제목 키워드 기반
Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions
In this paper, we propose a novel configurable framework to automatically generate distractive choices for open-domain cloze-style multiple-choice questions, which incorporates a general-purpose knowledge base to effecti…
Distractor GenerationLearning-To-RankMultiple-choiceGenerating Plausible Distractors for Multiple-Choice Questions via Student Choice Prediction
In designing multiple-choice questions (MCQs) in education, creating plausible distractors is crucial for identifying students' misconceptions and gaps in knowledge and accurately assessing their understanding. However, …
Distractor GenerationMisconceptionsMultiple-choiceImproving Automated Distractor Generation for Math Multiple-choice Questions with Overgenerate-and-rank
Multiple-choice questions (MCQs) are commonly used across all levels of math education since they can be deployed and graded at a large scale. A critical component of MCQs is the distractors, i.e., incorrect answers craf…
Distractor GenerationMathMisconceptionsMultiple-choiceAutomatic Distractor Suggestion for Multiple-Choice Tests Using Concept Embeddings and Information Retrieval
Developing plausible distractors (wrong answer options) when writing multiple-choice questions has been described as one of the most challenging and time-consuming parts of the item-writing process. In this paper we prop…
Information RetrievalMultiple-choiceRetrievalDISTO: Evaluating Textual Distractors for Multi-Choice Questions using Negative Sampling based Approach
Multiple choice questions (MCQs) are an efficient and common way to assess reading comprehension (RC). Every MCQ needs a set of distractor answers that are incorrect, but plausible enough to test student knowledge. Distr…
Distractor GenerationMachine TranslationMultiple-choiceReading Comprehension+1