paper-with-me

홈 › Papers

The Geometry of Queries: Query-Based Innovations in Retrieval-Augmented Generation

2024-07-25 · Eric Yang, Jonathan Amar, Jong Ha Lee, Bhawesh Kumar, Yugang Jia

Digital health chatbots powered by Large Language Models (LLMs) have the potential to significantly improve personal health management for chronic conditions by providing accessible and on-demand health coaching and question-answering. However, these chatbots risk providing unverified and inaccurate information because LLMs generate responses based on patterns learned from diverse internet data. Retrieval Augmented Generation (RAG) can help mitigate hallucinations and inaccuracies in LLM responses by grounding it on reliable content. However, efficiently and accurately retrieving most relevant set of content for real-time user questions remains a challenge. In this work, we introduce Query-Based Retrieval Augmented Generation (QB-RAG), a novel approach that pre-computes a database of potential queries from a content base using LLMs. For an incoming patient question, QB-RAG efficiently matches it against this pre-generated query database using vector search, improving alignment between user questions and the content. We establish a theoretical foundation for QB-RAG and provide a comparative analysis of existing retrieval enhancement techniques for RAG systems. Finally, our empirical evaluation demonstrates that QB-RAG significantly improves the accuracy of healthcare question answering, paving the way for robust and trustworthy LLM applications in digital health.

📄 PDF Abstract BibTeX arXiv:2407.18044

Code (0)

등록된 구현이 없습니다.

Tasks

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Multi-Head Attention 설명 없음
Weight Decay 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Tree-Augmented Cross-Modal Encoding for Complex-Query Video Retrieval

2020-07-06 · Xun Yang, Jianfeng Dong, Yixin Cao, Xun Wang 외

The rapid growth of user-generated videos on the Internet has intensified the need for text-based video retrieval systems. Traditional methods mainly favor the concept-based paradigm on retrieval with simple queries, whi…

RetrievalVideo Retrieval

ROG: Retrieval-Augmented LLM Reasoning for Complex First-Order Queries over Knowledge Graphs

2026-02-02 · Ziyan Zhang, Chao Wang, Zhuo Chen, Chiyi Li 외 arxiv

Answering first-order logic (FOL) queries over incomplete knowledge graphs (KGs) is difficult, especially for complex query structures that compose projection, intersection, union, and negation. We propose ROG, a retriev…

Logical ReasoningKnowledge Graphs

RoRA-VLM: Robust Retrieval-Augmented Vision Language Models

2024-10-11 · Jingyuan Qi, Zhiyang Xu, Rulin Shao, Yang Chen 외

Current vision-language models (VLMs) still exhibit inferior performance on knowledge-intensive tasks, primarily due to the challenge of accurately encoding all the associations between visual objects and scenes to their…

Retrieval

Beyond Vector Similarity: A Structural Analysis of Graph-Augmented Retrieval for Industrial Knowledge Graphs

2026-06-04 · Grama Chethan arxiv

Retrieval-Augmented Generation (RAG) fails systematically on queries requiring structural reasoning over interconnected entities. We compare eight retrieval architectures for aerospace supply chain intelligence, progress…

Knowledge GraphsText Retrieval

Meta Knowledge for Retrieval Augmented Large Language Models

2024-08-16 · Laurent Mombaerts, Terry Ding, Adi Banerjee, Florian Felice 외

Retrieval Augmented Generation (RAG) is a technique used to augment Large Language Models (LLMs) with contextually relevant, time-critical, or domain-specific information without altering the underlying model parameters.…

ChunkingInformation RetrievalRAGRetrieval+2