paper-with-me

Papers

Multi-Meta-RAG: Improving RAG for Multi-Hop Queries using Database Filtering with LLM-Extracted Metadata

2024-06-19 · Mykhailo Poliakov, Nadiya Shvai

The retrieval-augmented generation (RAG) enables retrieval of relevant information from an external knowledge source and allows large language models (LLMs) to answer queries over previously unseen document collections. However, it was demonstrated that traditional RAG applications perform poorly in answering multi-hop questions, which require retrieving and reasoning over multiple elements of supporting evidence. We introduce a new method called Multi-Meta-RAG, which uses database filtering with LLM-extracted metadata to improve the RAG selection of the relevant documents from various sources, relevant to the question. While database filtering is specific to a set of questions from a particular domain and format, we found out that Multi-Meta-RAG greatly improves the results on the MultiHop-RAG benchmark. The code is available at https://github.com/mxpoliakov/Multi-Meta-RAG.

📄 PDF Abstract BibTeX arXiv:2406.13213

Code (1)

mxpoliakov/multi-meta-rag 공식 구현

Tasks

RAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
WordPiece 설명 없음
Residual Connection 설명 없음
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…

Similar Papers 제목 키워드 기반

Evaluation of LLMs in retrieving food and nutritional context for RAG systems

2026-03-10 · Maks Požarnik Vavken, Matevž Ogrinc, Tome Eftimov, Barbara Koroušić Seljak arxiv

In this article, we evaluate four Large Language Models (LLMs) and their effectiveness at retrieving data within a specialized Retrieval-Augmented Generation (RAG) system, using a comprehensive food composition database.…

Natural Language Queries

Curator: Efficient Indexing for Multi-Tenant Vector Databases

2024-01-13 · Yicheng Jin, Yongji Wu, WenJun Hu, Bruce M. Maggs 외

Vector databases have emerged as key enablers for bridging intelligent applications with unstructured data, providing generic search and management support for embedding vectors extracted from the raw unstructured data. …

Clustering

Probe, Don't Prompt: A Hidden-State Probe for Metadata Filtering in Multi-Meta-RAG

2026-07-04 · Mykhailo Poliakov, Nadiya Shvai arxiv

Multi-Meta-RAG improves retrieval for multi-hop question answering by filtering a vector store on metadata (the news source) that it extracts from each query by prompting gpt-3.5-turbo. We show this proprietary, free-for…

Multi-hop Question Answering

Database Reasoning Over Text

2021-06-02 · ACL 2021 5 · James Thorne, Majid Yazdani, Marzieh Saeidi, Fabrizio Silvestri 외

Neural models have shown impressive performance gains in answering queries from natural language text. However, existing works are unable to support database queries, such as "List/Count all female athletes who were born…

Complex Coordinate-Based Meta-Analysis with Probabilistic Programming

2020-12-02 · Valentin Iovene, Gaston Zanitti, Demian Wassermann

With the growing number of published functional magnetic resonance imaging (fMRI) studies, meta-analysis databases and models have become an integral part of brain mapping research. Coordinate-based meta-analysis (CBMA) …

Probabilistic Programming