Enhancing Distractor Generation for Multiple-Choice Questions with Retrieval Augmented Pretraining and Knowledge Graph Integration
In this paper, we tackle the task of distractor generation (DG) for multiple-choice questions. Our study introduces two key designs. First, we propose \textit{retrieval augmented pretraining}, which involves refining the language model pretraining to align it more closely with the downstream task of DG. Second, we explore the integration of knowledge graphs to enhance the performance of DG. Through experiments with benchmarking datasets, we show that our models significantly outperform the state-of-the-art results. Our best-performing model advances the F1@3 score from 14.80 to 16.47 in MCQ dataset and from 15.92 to 16.50 in Sciq dataset.
Code (0)
등록된 구현이 없습니다.
Tasks
BenchmarkingDistractor GenerationKnowledge GraphsLanguage ModelingLanguage ModellingMultiple-choiceRetrievalMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Generating Plausible Distractors for Multiple-Choice Questions via Student Choice Prediction
In designing multiple-choice questions (MCQs) in education, creating plausible distractors is crucial for identifying students' misconceptions and gaps in knowledge and accurately assessing their understanding. However, …
Distractor GenerationMisconceptionsMultiple-choiceChain-of-Exemplar: Enhancing Distractor Generation for Multimodal Educational Question Generation
Multiple-choice questions (MCQs) are important in enhancing concept learning and student engagement for educational purposes. Despite the multimodal nature of educational content, current methods focus mainly on text-bas…
Distractor GenerationMultiple-choiceQuestion GenerationQuestion-Generation+1Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions
In this paper, we propose a novel configurable framework to automatically generate distractive choices for open-domain cloze-style multiple-choice questions, which incorporates a general-purpose knowledge base to effecti…
Distractor GenerationLearning-To-RankMultiple-choiceDistractor Generation for Multiple Choice Questions Using Learning to Rank
We investigate how machine learning models, specifically ranking models, can be used to select useful distractors for multiple choice questions. Our proposed models can learn to select distractors that resemble those in …
BIG-bench Machine LearningDistractor GenerationEnsemble LearningLearning-To-Rank+1Distractor Generation in Multiple-Choice Tasks: A Survey of Methods, Datasets, and Evaluation
The distractor generation task focuses on generating incorrect but plausible options for objective questions such as fill-in-the-blank and multiple-choice questions. This task is widely utilized in educational settings a…
Distractor GenerationMultiple-choice