On the Importance of Diversity in Question Generation for QA
Automatic question generation (QG) has shown promise as a source of synthetic training data for question answering (QA). In this paper we ask: Is textual diversity in QG beneficial for downstream QA? Using top-p nucleus sampling to derive samples from a transformer-based question generator, we show that diversity-promoting QG indeed provides better QA training than likelihood maximization approaches such as beam search. We also show that standard QG evaluation metrics such as BLEU, ROUGE and METEOR are inversely correlated with diversity, and propose a diversity-aware intrinsic measure of overall QG quality that correlates well with extrinsic evaluation on QA.
Code (0)
등록된 구현이 없습니다.
Tasks
DiversityQuestion AnsweringQuestion GenerationQuestion-GenerationSimilar Papers 제목 키워드 기반
Diversifying Question Generation over Knowledge Base via External Natural Questions
Previous methods on knowledge base question generation (KBQG) primarily focus on enhancing the quality of a single generated question. Recognizing the remarkable paraphrasing ability of humans, we contend that diverse te…
DiversityNatural QuestionsQuestion AnsweringQuestion Generation+1Explicit Diversity Conditions for Effective Question Answer Generation with Large Language Models
Question Answer Generation (QAG) is an effective data augmentation technique to improve the accuracy of question answering systems, especially in low-resource domains. While recent pretrained and large language model-bas…
Answer GenerationData AugmentationDiversityLanguage Modeling+4Benchmarking Linguistic Diversity of Large Language Models
The development and evaluation of Large Language Models (LLMs) has primarily focused on their task-solving capabilities, with recent models even surpassing human performance in some areas. However, this focus often negle…
BenchmarkingDiversityText GenerationDiversity-Enhanced Reasoning for Subjective Questions
Large Reasoning Models (LRMs) with long chain-of-thought capabilities, optimized via reinforcement learning with verifiable rewards (RLVR), excel at objective reasoning tasks like mathematical problem solving and code ge…
Reinforcement LearningCode GenerationDiversify Question Generation with Continuous Content Selectors and Question Type Modeling
Generating questions based on answers and relevant contexts is a challenging task. Recent work mainly pays attention to the quality of a single generated question. However, question generation is actually a one-to-many p…
DiversityQuestion GenerationQuestion-GenerationVocal Bursts Type Prediction