paper-with-me

Papers

EfficientRAG: Efficient Retriever for Multi-Hop Question Answering

2024-08-08 · Ziyuan Zhuang, Zhiyang Zhang, Sitao Cheng, Fangkai Yang, Jia Liu, ShuJian Huang, QIngwei Lin, Saravan Rajmohan, Dongmei Zhang, Qi Zhang

Retrieval-augmented generation (RAG) methods encounter difficulties when addressing complex questions like multi-hop queries. While iterative retrieval methods improve performance by gathering additional information, current approaches often rely on multiple calls of large language models (LLMs). In this paper, we introduce EfficientRAG, an efficient retriever for multi-hop question answering. EfficientRAG iteratively generates new queries without the need for LLM calls at each iteration and filters out irrelevant information. Experimental results demonstrate that EfficientRAG surpasses existing RAG methods on three open-domain multi-hop question-answering datasets.

📄 PDF Abstract BibTeX arXiv:2408.04259

Code (1)

nil-zhuang/efficientrag-official 공식 구현 pytorch

Tasks

Multi-hop Question AnsweringQuestion AnsweringRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

A Comprehensive Evaluation of Transformer-Based Question Answering Models and RAG-Enhanced Design

2025-09-26 · Zichen Zhang, Kunlong Zhang, Hongwei Ruan, Yiming Luo arxiv

Transformer-based models have advanced the field of question answering, but multi-hop reasoning, where answers require combining evidence across multiple passages, remains difficult. This paper presents a comprehensive e…

Multi-hop Question Answering

Silver Retriever: Advancing Neural Passage Retrieval for Polish Question Answering

2023-09-15 · Piotr Rybak, Maciej Ogrodniczuk

Modern open-domain question answering systems often rely on accurate and efficient retrieval components to find passages containing the facts necessary to answer the question. Recently, neural retrievers have gained popu…

Open-Domain Question AnsweringPassage RetrievalQuestion AnsweringRetrieval

Answering Complex Open-domain Questions Through Iterative Query Generation

2019-10-15 · IJCNLP 2019 11 · Peng Qi, Xiaowen Lin, Leo Mehr, Zijian Wang 외

It is challenging for current one-step retrieve-and-read question answering (QA) systems to answer questions like "Which novel by the author of 'Armada' will be adapted as a feature film by Steven Spielberg?" because the…

Information RetrievalQuestion AnsweringRetrieval

A Multimodal Dense Retrieval Approach for Speech-Based Open-Domain Question Answering

2024-09-20 · Georgios Sidiropoulos, Evangelos Kanoulas

Speech-based open-domain question answering (QA over a large corpus of text passages with spoken questions) has emerged as an important task due to the increasing number of users interacting with QA systems via speech in…

Automatic Speech RecognitionAutomatic Speech Recognition (ASR)Open-Domain Question AnsweringPassage Retrieval+4

Distilling Knowledge from Reader to Retriever for Question Answering

2020-12-08 · ICLR 2021 1 · Gautier Izacard, Edouard Grave

The task of information retrieval is an important component of many natural language processing systems, such as open domain question answering. While traditional methods were based on hand-crafted features, continuous r…

Information RetrievalKnowledge DistillationOpen-Domain Question AnsweringQuestion Answering+1