paper-with-me

홈 › Papers

An Empirical Comparison of LM-based Question and Answer Generation Methods

2023-05-26 · Asahi Ushio, Fernando Alva-Manchego, Jose Camacho-Collados

Question and answer generation (QAG) consists of generating a set of question-answer pairs given a context (e.g. a paragraph). This task has a variety of applications, such as data augmentation for question answering (QA) models, information retrieval and education. In this paper, we establish baselines with three different QAG methodologies that leverage sequence-to-sequence language model (LM) fine-tuning. Experiments show that an end-to-end QAG model, which is computationally light at both training and inference times, is generally robust and outperforms other more convoluted approaches. However, there are differences depending on the underlying generative LM. Finally, our analysis shows that QA models fine-tuned solely on generated question-answer pairs can be competitive when compared to supervised QA models trained on human-labeled data.

📄 PDF Abstract BibTeX arXiv:2305.17002

Code (1)

asahi417/lm-question-generation 공식 구현

Tasks

Answer GenerationData AugmentationInformation RetrievalLanguage ModelingLanguage ModellingQuestion AnsweringRetrieval

Similar Papers 제목 키워드 기반

An Empirical Comparison of Question Classification Methods for Question Answering Systems

2020-05-01 · LREC 2020 5 · Eduardo Cortes, Vinicius Woloszyn, Arne Binder, Tilo Himmelsbach 외

Question classification is an important component of Question Answering Systems responsible for identifying the type of an answer a particular question requires. For instance, {``}Who is the prime minister of the United …

ClassificationGeneral ClassificationQuestion Answering

Reinforced Dynamic Reasoning for Conversational Question Generation

2019-07-29 · ACL 2019 7 · Boyuan Pan, Hao Li, Ziyu Yao, Deng Cai 외

This paper investigates a new task named Conversational Question Generation (CQG) which is to generate a question based on a passage and a conversation history (i.e., previous turns of question-answer pairs). CQG is a cr…

DecoderQuestion AnsweringQuestion GenerationQuestion-Generation+1

SkillQG: Learning to Generate Question for Reading Comprehension Assessment

2023-05-08 · Xiaoqiang Wang, Bang Liu, Siliang Tang, Lingfei Wu

We present $\textbf{$\texttt{SkillQG}$}$: a question generation framework with controllable comprehension types for assessing and improving machine reading comprehension models. Existing question generation systems widel…

Machine Reading ComprehensionQuestion AnsweringQuestion GenerationQuestion-Generation+1

Classification from Triplet Comparison Data

2019-07-24 · Zhenghang Cui, Nontawat Charoenphakdee, Issei Sato, Masashi Sugiyama

Learning from triplet comparison data has been extensively studied in the context of metric learning, where we want to learn a distance metric between two instances, and ordinal embedding, where we want to learn an embed…

ClassificationGeneral ClassificationMetric LearningTriplet

Read before Generate! Faithful Long Form Question Answering with Machine Reading

2022-03-01 · Findings (ACL) 2022 5 · Dan Su, Xiaoguang Li, Jindi Zhang, Lifeng Shang 외

Long-form question answering (LFQA) aims to generate a paragraph-length answer for a given question. While current work on LFQA using large pre-trained model for generation are effective at producing fluent and somewhat …

Answer GenerationFormLong Form Question AnsweringQuestion Answering+1