Automatic Generation of Distractors for Fill-in-the-Blank Exercises with Round-Trip Neural Machine Translation
In a fill-in-the-blank exercise, a student is presented with a carrier sentence with one word hidden, and a multiple-choice list that includes the correct answer and several inappropriate options, called distractors. We propose to automatically generate distractors using round-trip neural machine translation: the carrier sentence is translated from English into another (pivot) language and back, and distractors are produced by aligning the original sentence and its round-trip translation. We show that using hundreds of translations for a given sentence allows us to generate a rich set of challenging distractors. Further, using multiple pivot languages produces a diverse set of candidates. The distractors are evaluated against a real corpus of cloze exercises and checked manually for validity. We demonstrate that the proposed method significantly outperforms two strong baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Machine TranslationMultiple-choiceSentenceTranslationSimilar Papers 제목 키워드 기반
Distractor Generation for Chinese Fill-in-the-blank Items
This paper reports the first study on automatic generation of distractors for fill-in-the-blank items for learning Chinese vocabulary. We investigate the quality of distractors generated by a number of criteria, includin…
Distractor GenerationSemantic SimilaritySemantic Textual SimilarityAutomatic Generation of Context-Based Fill-in-the-Blank Exercises Using Co-occurrence Likelihoods and Google n-grams
Learning from Partially Annotated Data: Example-aware Creation of Gap-filling Exercises for Language Learning
Since performing exercises (including, e.g., practice tests) forms a crucial component of learning, and creating such exercises requires non-trivial effort from the teacher, there is a great value in automatic exercise g…
SCDE: Sentence Cloze Dataset with High Quality Distractors From Examinations
We introduce SCDE, a dataset to evaluate the performance of computational models through sentence prediction. SCDE is a human-created sentence cloze dataset, collected from public school English examinations. Our task re…
Question AnsweringSentenceVocal Bursts Intensity PredictionLearning to Automatically Generate Fill-In-The-Blank Quizzes
In this paper we formalize the problem automatic fill-in-the-blank question generation using two standard NLP machine learning schemes, proposing concrete deep learning models for each. We present an empirical study base…
BIG-bench Machine LearningDeep LearningQuestion GenerationQuestion-Generation