Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions
In this paper, we propose a novel configurable framework to automatically generate distractive choices for open-domain cloze-style multiple-choice questions, which incorporates a general-purpose knowledge base to effectively create a small distractor candidate set, and a feature-rich learning-to-rank model to select distractors that are both plausible and reliable. Experimental results on datasets across four domains show that our framework yields distractors that are more plausible and reliable than previous methods. This dataset can also be used as a benchmark for distractor generation in the future.
Code (0)
등록된 구현이 없습니다.
Tasks
Distractor GenerationLearning-To-RankMultiple-choiceSimilar Papers 제목 키워드 기반
DGRC: An Effective Fine-tuning Framework for Distractor Generation in Chinese Multi-choice Reading Comprehension
When evaluating a learner's knowledge proficiency, the multiple-choice question is an efficient and widely used format in standardized tests. Nevertheless, generating these questions, particularly plausible distractors (…
Distractor GenerationMultiple-choiceMulti-Task LearningNatural Questions+1CDGP: Automatic Cloze Distractor Generation based on Pre-trained Language Model
Manually designing cloze test consumes enormous time and efforts. The major challenge lies in wrong option (distractor) selection. Having carefully-design distractors improves the effectiveness of learner ability assessm…
Cloze TestDistractor GenerationLanguage ModelingLanguage ModellingDifficulty-Controllable Cloze Question Distractor Generation
Multiple-choice cloze questions are commonly used to assess linguistic proficiency and comprehension. However, generating high-quality distractors remains challenging, as existing methods often lack adaptability and cont…
Distractor GenerationData AugmentationDualReward: A Dynamic Reinforcement Learning Framework for Cloze Tests Distractor Generation
This paper introduces DualReward, a novel reinforcement learning framework for automatic distractor generation in cloze tests. Unlike conventional approaches that rely primarily on supervised learning or static generativ…
Reinforcement LearningDistractor GenerationCloze TestInDEX: Indonesian Idiom and Expression Dataset for Cloze Test
We propose InDEX, an Indonesian Idiom and Expression dataset for cloze test. The dataset contains 10438 unique sentences for 289 idioms and expressions for which we generate 15 different types of distractors, resulting i…
Cloze TestReading Comprehension