Optimizing Query Generation for Enhanced Document Retrieval in RAG

2024-07-17 · Hamin Koo, Minseon Kim, Sung Ju Hwang

Large Language Models (LLMs) excel in various language tasks but they often generate incorrect information, a phenomenon known as "hallucinations". Retrieval-Augmented Generation (RAG) aims to mitigate this by using document retrieval for accurate responses. However, RAG still faces hallucinations due to vague queries. This study aims to improve RAG by optimizing query generation with a query-document alignment score, refining queries using LLMs for better precision and efficiency of document retrieval. Experiments have shown that our approach improves document retrieval, resulting in an average accuracy gain of 1.6%.

📄 PDF Abstract BibTeX arXiv:2407.12325

Code (0)

등록된 구현이 없습니다.

Tasks

RAG RetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…

Attention 설명 없음

Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.

Residual Connection 설명 없음

Adam 설명 없음

Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Enhanced Retrieval of Long Documents: Leveraging Fine-Grained Block Representations with Large Language Models

2025-01-28 · Minghan Li, Eric Gaussier, Guodong Zhou

In recent years, large language models (LLMs) have demonstrated exceptional power in various domains, including information retrieval. Most of the previous practices involve leveraging these models to create a single emb…

Information Retrieval RAG Retrieval Retrieval-augmented Generation

Generation-Augmented Query Expansion For Code Retrieval

2022-12-20 · Dong Li, Yelong Shen, Ruoming Jin, Yi Mao 외

Pre-trained language models have achieved promising success in code retrieval tasks, where a natural language documentation query is given to find the most relevant existing code snippet. However, existing models focus o…

Code Generation Retrieval

Query pipeline optimization for cancer patient question answering systems

2024-12-19 · Maolin He, Rena Gao, Mike Conway, Brian E. Chapman

Retrieval-augmented generation (RAG) mitigates hallucination in Large Language Models (LLMs) by using query pipelines to retrieve relevant external information and grounding responses in retrieved knowledge. However, que…

Hallucination Passage Retrieval Question Answering RAG+2

Query-Aware Graph Neural Networks for Enhanced Retrieval-Augmented Generation

2025-07-25 · Vibhor Agrawal, Fay Wang, Rishi Puri arxiv

We present a novel graph neural network (GNN) architecture for retrieval-augmented generation (RAG) that leverages query-aware attention mechanisms and learned scoring heads to improve retrieval accuracy on complex, mult…

Graph Neural Network Question Answering Knowledge Graphs

Query Generation Pipeline with Enhanced Answerability Assessment for Financial Information Retrieval

2025-11-07 · Hyunkyu Kim, Yeeun Yoo, Youngjun Kwak arxiv

As financial applications of large language models (LLMs) gain attention, accurate Information Retrieval (IR) remains crucial for reliable AI services. However, existing benchmarks fail to capture the complex and domain-…

Information Retrieval