Automatic Distractor Generation for Multiple Choice Questions in Standard Tests
To assess the knowledge proficiency of a learner, multiple choice question is an efficient and widespread form in standard tests. However, the composition of the multiple choice question, especially the construction of distractors is quite challenging. The distractors are required to both incorrect and plausible enough to confuse the learners who did not master the knowledge. Currently, the distractors are generated by domain experts which are both expensive and time-consuming. This urges the emergence of automatic distractor generation, which can benefit various standard tests in a wide range of domains. In this paper, we propose a question and answer guided distractor generation (EDGE) framework to automate distractor generation. EDGE consists of three major modules: (1) the Reforming Question Module and the Reforming Passage Module apply gate layers to guarantee the inherent incorrectness of the generated distractors; (2) the Distractor Generator Module applies attention mechanism to control the level of plausibility. Experimental results on a large-scale public dataset demonstrate that our model significantly outperforms existing models and achieves a new state-of-the-art.
Code (0)
등록된 구현이 없습니다.
Tasks
Distractor GenerationMultiple-choiceSimilar Papers 제목 키워드 기반
Knowledge-Driven Distractor Generation for Cloze-style Multiple Choice Questions
In this paper, we propose a novel configurable framework to automatically generate distractive choices for open-domain cloze-style multiple-choice questions, which incorporates a general-purpose knowledge base to effecti…
Distractor GenerationLearning-To-RankMultiple-choiceAutomatic Distractor Suggestion for Multiple-Choice Tests Using Concept Embeddings and Information Retrieval
Developing plausible distractors (wrong answer options) when writing multiple-choice questions has been described as one of the most challenging and time-consuming parts of the item-writing process. In this paper we prop…
Information RetrievalMultiple-choiceRetrievalDistractor Analysis and Selection for Multiple-Choice Cloze Questions for Second-Language Learners
We consider the problem of automatically suggesting distractors for multiple-choice cloze questions designed for second-language learners. We describe the creation of a dataset including collecting manual annotations for…
Multiple-choiceImproving Automated Distractor Generation for Math Multiple-choice Questions with Overgenerate-and-rank
Multiple-choice questions (MCQs) are commonly used across all levels of math education since they can be deployed and graded at a large scale. A critical component of MCQs is the distractors, i.e., incorrect answers craf…
Distractor GenerationMathMisconceptionsMultiple-choiceGenerating Adequate Distractors for Multiple-Choice Questions
This paper presents a novel approach to automatic generation of adequate distractors for a given question-answer pair (QAP) generated from a given article to form an adequate multiple-choice question (MCQ). Our method is…
FormMultiple-choicePart-Of-Speech TaggingSemantic Role Labeling+1