paper-with-me

홈 › Papers

Downstream Transformer Generation of Question-Answer Pairs with Preprocessing and Postprocessing Pipelines

2022-05-15 · Cheng Zhang, Hao Zhang, Jie Wang

We present a system called TP3 to perform a downstream task of transformers on generating question-answer pairs (QAPs) from a given article. TP3 first finetunes pretrained transformers on QAP datasets, then uses a preprocessing pipeline to select appropriate answers, feeds the relevant sentences and the answer to the finetuned transformer to generate candidate QAPs, and finally uses a postprocessing pipeline to filter inadequate QAPs. In particular, using pretrained T5 models as transformers and the SQuAD dataset as the finetruning dataset, we show that TP3 generates satisfactory number of QAPs with high qualities on the Gaokao-EN dataset.

📄 PDF Abstract BibTeX arXiv:2205.07387

Code (1)

zhangchengx/T5-Fine-Tuning-for-Question-Generation 공식 구현 pytorch

Methods 이 논문이 사용한 방법론

Gated Linear Unit A Gated Linear Unit, or GLU computes: $$ \mathrm{GLU}(a, b) = a \otimes \sigma(b) $$ It is used in natural language processing architectures, for example the Gated CNN,…
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
SentencePiece 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Learning to Answer by Learning to Ask: Getting the Best of GPT-2 and BERT Worlds

2019-11-06 · Tassilo Klein, Moin Nabi

Automatic question generation aims at the generation of questions from a context, with the corresponding answers being sub-spans of the given passage. Whereas, most of the methods mostly rely on heuristic rules to genera…

DecoderLanguage ModellingQuestion AnsweringQuestion Generation+2

Automatic Generation of Multiple-Choice Questions

2023-03-25 · Cheng Zhang

Creating multiple-choice questions to assess reading comprehension of a given article involves generating question-answer pairs (QAPs) and adequate distractors. We present two methods to tackle the challenge of QAP gener…

Multiple-choicePart-Of-Speech TaggingQuestion GenerationQuestion-Generation+4

Diversity and Consistency: Exploring Visual Question-Answer Pair Generation

2021-11-01 · Findings (EMNLP) 2021 11 · Sen yang, Qingyu Zhou, Dawei Feng, Yang Liu 외

Although showing promising values to downstream applications, generating question and answer together is under-explored. In this paper, we introduce a novel task that targets question-answer pair generation from visual i…

DiversityQuestion AnsweringQuestion GenerationQuestion-Generation+3

Explicit Diversity Conditions for Effective Question Answer Generation with Large Language Models

2024-06-26 · Vikas Yadav, Hyuk Joon Kwon, Vijay Srinivasan, Hongxia Jin

Question Answer Generation (QAG) is an effective data augmentation technique to improve the accuracy of question answering systems, especially in low-resource domains. While recent pretrained and large language model-bas…

Answer GenerationData AugmentationDiversityLanguage Modeling+4

Generating Natural Language Question-Answer Pairs from a Knowledge Graph Using a RNN Based Question Generation Model

2017-04-01 · EACL 2017 4 · Sathish Reddy, Dinesh Raghu, Mitesh M. Khapra, Sachindra Joshi

In recent years, knowledge graphs such as Freebase that capture facts about entities and relationships between them have been used actively for answering factoid questions. In this paper, we explore the problem of automa…

Knowledge GraphsQuestion AnsweringQuestion GenerationQuestion-Generation