PIE-QG: Paraphrased Information Extraction for Unsupervised Question Generation from Small Corpora
Supervised Question Answering systems (QA systems) rely on domain-specific human-labeled data for training. Unsupervised QA systems generate their own question-answer training pairs, typically using secondary knowledge sources to achieve this outcome. Our approach (called PIE-QG) uses Open Information Extraction (OpenIE) to generate synthetic training questions from paraphrased passages and uses the question-answer pairs as training data for a language model for a state-of-the-art QA system based on BERT. Triples in the form of <subject, predicate, object> are extracted from each passage, and questions are formed with subjects (or objects) and predicates while objects (or subjects) are considered as answers. Experimenting on five extractive QA datasets demonstrates that our technique achieves on-par performance with existing state-of-the-art QA systems with the benefit of being trained on an order of magnitude fewer documents and without any recourse to external reference data sources.
Code (0)
등록된 구현이 없습니다.
Tasks
Language ModelingLanguage ModellingOpen Information ExtractionQuestion AnsweringQuestion GenerationQuestion-GenerationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Improving the Robustness of Question Answering Systems to Question Paraphrasing
Despite the advancement of question answering (QA) systems and rapid improvements on held-out test sets, their generalizability is a topic of concern. We explore the robustness of QA models to question paraphrasing by cr…
Data AugmentationQuestion AnsweringUnsupervised Candidate Answer Extraction through Differentiable Masker-Reconstructor Model
Question generation is a widely used data augmentation approach with extensive applications, and extracting qualified candidate answers from context passages is a critical step for most question generation systems. Howev…
Data AugmentationQuestion GenerationQuestion-GenerationEntity-Enriched Neural Models for Clinical Question Answering
We explore state-of-the-art neural models for question answering on electronic medical records and improve their ability to generalize better on previously unseen (paraphrased) questions at test time. We enable this by l…
Question AnsweringKHANQ: A Dataset for Generating Deep Questions in Education
Designing in-depth educational questions is a time-consuming and cognitively demanding task. Therefore, it is intriguing to study how to build Question Generation (QG) models to automate the question creation process. Ho…
Question GenerationQuestion-GenerationData Extraction Attacks in Retrieval-Augmented Generation via Backdoors
Despite significant advancements, large language models (LLMs) still struggle with providing accurate answers when lacking domain-specific or up-to-date knowledge. Retrieval-Augmented Generation (RAG) addresses this limi…
Instruction FollowingRAGRetrievalRetrieval-augmented Generation