Evaluating for Diversity in Question Generation over Text
Generating diverse and relevant questions over text is a task with widespread applications. We argue that commonly-used evaluation metrics such as BLEU and METEOR are not suitable for this task due to the inherent diversity of reference questions, and propose a scheme for extending conventional metrics to reflect diversity. We furthermore propose a variational encoder-decoder model for this task. We show through automatic and human evaluation that our variational model improves diversity without loss of quality, and demonstrate how our evaluation scheme reflects this improvement.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderDiversityQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
Diversity and Consistency: Exploring Visual Question-Answer Pair Generation
Although showing promising values to downstream applications, generating question and answer together is under-explored. In this paper, we introduce a novel task that targets question-answer pair generation from visual i…
DiversityQuestion AnsweringQuestion GenerationQuestion-Generation+3Evaluating the Evaluation of Diversity in Natural Language Generation
Despite growing interest in natural language generation (NLG) models that produce diverse outputs, there is currently no principled method for evaluating the diversity of an NLG system. In this work, we propose a framewo…
DiversityText GenerationDiversify Question Generation with Continuous Content Selectors and Question Type Modeling
Generating questions based on answers and relevant contexts is a challenging task. Recent work mainly pays attention to the quality of a single generated question. However, question generation is actually a one-to-many p…
DiversityQuestion GenerationQuestion-GenerationVocal Bursts Type PredictionOn the Importance of Diversity in Question Generation for QA
Automatic question generation (QG) has shown promise as a source of synthetic training data for question answering (QA). In this paper we ask: Is textual diversity in QG beneficial for downstream QA? Using top-p nucleus …
DiversityQuestion AnsweringQuestion GenerationQuestion-GenerationDiversifying Question Generation over Knowledge Base via External Natural Questions
Previous methods on knowledge base question generation (KBQG) primarily focus on enhancing the quality of a single generated question. Recognizing the remarkable paraphrasing ability of humans, we contend that diverse te…
DiversityNatural QuestionsQuestion AnsweringQuestion Generation+1