paper-with-me

홈 › Papers

QPaug: Question and Passage Augmentation for Open-Domain Question Answering of LLMs

2024-06-20 · Minsang Kim, Cheoneum Park, Seungjun Baek

Retrieval-augmented generation (RAG) has received much attention for Open-domain question-answering (ODQA) tasks as a means to compensate for the parametric knowledge of large language models (LLMs). While previous approaches focused on processing retrieved passages to remove irrelevant context, they still rely heavily on the quality of retrieved passages which can degrade if the question is ambiguous or complex. In this paper, we propose a simple yet efficient method called question and passage augmentation (QPaug) via LLMs for open-domain QA. QPaug first decomposes the original questions into multiple-step sub-questions. By augmenting the original question with detailed sub-questions and planning, we are able to make the query more specific on what needs to be retrieved, improving the retrieval performance. In addition, to compensate for the case where the retrieved passages contain distracting information or divided opinions, we augment the retrieved passages with self-generated passages by LLMs to guide the answer extraction. Experimental results show that QPaug outperforms the previous state-of-the-art and achieves significant performance gain over existing RAG methods. The source code is available at \url{https://github.com/kmswin1/QPaug}.

📄 PDF Abstract BibTeX arXiv:2406.14277

Code (1)

kmswin1/qpaug 공식 구현 pytorch

Tasks

Open-Domain Question AnsweringQuestion AnsweringRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
WordPiece 설명 없음
Residual Connection 설명 없음
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

ZusammenQA: Data Augmentation with Specialized Models for Cross-lingual Open-retrieval Question Answering System

2022-05-30 · NAACL (MIA) 2022 7 · Chia-Chien Hung, Tommaso Green, Robert Litschko, Tornike Tsereteli 외

This paper introduces our proposed system for the MIA Shared Task on Cross-lingual Open-retrieval Question Answering (COQA). In this challenging scenario, given an input question the system has to gather evidence documen…

Answer GenerationData AugmentationLanguage ModellingPassage Retrieval+2

RocketQA: An Optimized Training Approach to Dense Passage Retrieval for Open-Domain Question Answering

2020-10-16 · NAACL 2021 4 · Yingqi Qu, Yuchen Ding, Jing Liu, Kai Liu 외

In open-domain question answering, dense passage retrieval has become a new paradigm to retrieve relevant passages for finding answers. Typically, the dual-encoder architecture is adopted to learn dense representations o…

Data AugmentationNatural QuestionsOpen-Domain Question AnsweringPassage Retrieval+2

On the Impact of Speech Recognition Errors in Passage Retrieval for Spoken Question Answering

2022-09-26 · Georgios Sidiropoulos, Svitlana Vakulenko, Evangelos Kanoulas

Interacting with a speech interface to query a Question Answering (QA) system is becoming increasingly popular. Typically, QA systems rely on passage retrieval to select candidate contexts and reading comprehension to ex…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Data AugmentationPassage Ranking+6

xMoCo: Cross Momentum Contrastive Learning for Open-Domain Question Answering

2021-08-01 · ACL 2021 5 · Nan Yang, Furu Wei, Binxing Jiao, Daxing Jiang 외

Dense passage retrieval has been shown to be an effective approach for information retrieval tasks such as open domain question answering. Under this paradigm, a dual-encoder model is learned to encode questions and pass…

Contrastive LearningInformation RetrievalOpen-Domain Question AnsweringPassage Retrieval+2

Passage-specific Prompt Tuning for Passage Reranking in Question Answering with Large Language Models

2024-05-31 · Xuyang Wu, Zhiyuan Peng, Krishna Sravanthi Rajanala Sai, Hsin-Tai Wu 외

Effective passage retrieval and reranking methods have been widely utilized to identify suitable candidates in open-domain question answering tasks, recent studies have resorted to LLMs for reranking the retrieved passag…

Open-Domain Question AnsweringPassage RerankingPassage RetrievalQuestion Answering+1