An Empirical Comparison of LM-based Question and Answer Generation Methods
Question and answer generation (QAG) consists of generating a set of question-answer pairs given a context (e.g. a paragraph). This task has a variety of applications, such as data augmentation for question answering (QA) models, information retrieval and education. In this paper, we establish baselines with three different QAG methodologies that leverage sequence-to-sequence language model (LM) fine-tuning. Experiments show that an end-to-end QAG model, which is computationally light at both training and inference times, is generally robust and outperforms other more convoluted approaches. However, there are differences depending on the underlying generative LM. Finally, our analysis shows that QA models fine-tuned solely on generated question-answer pairs can be competitive when compared to supervised QA models trained on human-labeled data.
Code (1)
Tasks
Answer GenerationData AugmentationInformation RetrievalLanguage ModelingLanguage ModellingQuestion AnsweringRetrievalSimilar Papers 제목 키워드 기반
An Empirical Comparison of Question Classification Methods for Question Answering Systems
Question classification is an important component of Question Answering Systems responsible for identifying the type of an answer a particular question requires. For instance, {``}Who is the prime minister of the United …
ClassificationGeneral ClassificationQuestion AnsweringReinforced Dynamic Reasoning for Conversational Question Generation
This paper investigates a new task named Conversational Question Generation (CQG) which is to generate a question based on a passage and a conversation history (i.e., previous turns of question-answer pairs). CQG is a cr…
DecoderQuestion AnsweringQuestion GenerationQuestion-Generation+1SkillQG: Learning to Generate Question for Reading Comprehension Assessment
We present $\textbf{$\texttt{SkillQG}$}$: a question generation framework with controllable comprehension types for assessing and improving machine reading comprehension models. Existing question generation systems widel…
Machine Reading ComprehensionQuestion AnsweringQuestion GenerationQuestion-Generation+1Classification from Triplet Comparison Data
Learning from triplet comparison data has been extensively studied in the context of metric learning, where we want to learn a distance metric between two instances, and ordinal embedding, where we want to learn an embed…
ClassificationGeneral ClassificationMetric LearningTripletRead before Generate! Faithful Long Form Question Answering with Machine Reading
Long-form question answering (LFQA) aims to generate a paragraph-length answer for a given question. While current work on LFQA using large pre-trained model for generation are effective at producing fluent and somewhat …
Answer GenerationFormLong Form Question AnsweringQuestion Answering+1