paper-with-me

홈 › Papers

PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora

2023-01-03 · Dinesh Nagumothu, Bahadorreza Ofoghi, Guangyan Huang, Peter W. Eklund

Supervised Question Answering systems (QA systems) rely on domain-specific human-labeled data for training. Unsupervised QA systems generate their own question-answer training pairs, typically using secondary knowledge sources to achieve this outcome. Our approach (called PIE-QG) uses Open Information Extraction (OpenIE) to generate synthetic training questions from paraphrased passages and uses the question-answer pairs as training data for a language model for a state-of-the-art QA system based on BERT. Triples in the form of <subject, predicate, object> are extracted from each passage, and questions are formed with subjects (or objects) and predicates while objects (or subjects) are considered as answers. Experimenting on five extractive QA datasets demonstrates that our technique achieves on-par performance with existing state-of-the-art QA systems with the benefit of being trained on an order of magnitude fewer documents and without any recourse to external reference data sources.

📄 PDF Abstract BibTeX arXiv:2301.01064

Code (0)

등록된 구현이 없습니다.

Tasks

Language ModelingLanguage ModellingOpen Information ExtractionQuestion AnsweringQuestion GenerationQuestion-Generation

Methods 이 논문이 사용한 방법론

Multi-Head Attention 설명 없음
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
WordPiece 설명 없음
Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Similar Papers 제목 키워드 기반

Improving the Robustness of Question Answering Systems to Question Paraphrasing

2019-07-01 · ACL 2019 7 · Wee Chung Gan, Hwee Tou Ng

Despite the advancement of question answering (QA) systems and rapid improvements on held-out test sets, their generalizability is a topic of concern. We explore the robustness of QA models to question paraphrasing by cr…

Data AugmentationQuestion Answering

Unsupervised Candidate Answer Extraction through Differentiable Masker-Reconstructor Model

2023-10-19 · Zhuoer Wang, Yicheng Wang, Ziwei Zhu, James Caverlee

Question generation is a widely used data augmentation approach with extensive applications, and extracting qualified candidate answers from context passages is a critical step for most question generation systems. Howev…

Data AugmentationQuestion GenerationQuestion-Generation

Entity-Enriched Neural Models for Clinical Question Answering

2020-05-13 · WS 2020 7 · Bhanu Pratap Singh Rawat, Wei-Hung Weng, So Yeon Min, Preethi Raghavan 외

We explore state-of-the-art neural models for question answering on electronic medical records and improve their ability to generalize better on previously unseen (paraphrased) questions at test time. We enable this by l…

Question Answering

KHANQ: A Dataset for Generating Deep Questions in Education

2022-10-01 · COLING 2022 10 · Huanli Gong, Liangming Pan, Hengchang Hu

Designing in-depth educational questions is a time-consuming and cognitively demanding task. Therefore, it is intriguing to study how to build Question Generation (QG) models to automate the question creation process. Ho…

Question GenerationQuestion-Generation

Data Extraction Attacks in Retrieval-Augmented Generation via Backdoors

2024-11-03 · Yuefeng Peng, Junda Wang, Hong Yu, Amir Houmansadr

Despite significant advancements, large language models (LLMs) still struggle with providing accurate answers when lacking domain-specific or up-to-date knowledge. Retrieval-Augmented Generation (RAG) addresses this limi…

Instruction FollowingRAGRetrievalRetrieval-augmented Generation