paper-with-me

홈 › Papers

POLYRAG: Integrating Polyviews into Retrieval-Augmented Generation for Medical Applications

2025-04-21 · Chunjing Gan, Dan Yang, Binbin Hu, Ziqi Liu, Yue Shen, Zhiqiang Zhang, Jian Wang, Jun Zhou

Large language models (LLMs) have become a disruptive force in the industry, introducing unprecedented capabilities in natural language processing, logical reasoning and so on. However, the challenges of knowledge updates and hallucination issues have limited the application of LLMs in medical scenarios, where retrieval-augmented generation (RAG) can offer significant assistance. Nevertheless, existing retrieve-then-read approaches generally digest the retrieved documents, without considering the timeliness, authoritativeness and commonality of retrieval. We argue that these approaches can be suboptimal, especially in real-world applications where information from different sources might conflict with each other and even information from the same source in different time scale might be different, and totally relying on this would deteriorate the performance of RAG approaches. We propose PolyRAG that carefully incorporate judges from different perspectives and finally integrate the polyviews for retrieval augmented generation in medical applications. Due to the scarcity of real-world benchmarks for evaluation, to bridge the gap we propose PolyEVAL, a benchmark consists of queries and documents collected from real-world medical scenarios (including medical policy, hospital & doctor inquiry and healthcare) with multiple tagging (e.g., timeliness, authoritativeness) on them. Extensive experiments and analysis on PolyEVAL have demonstrated the superiority of PolyRAG.

📄 PDF Abstract BibTeX arXiv:2504.14917

Code (0)

등록된 구현이 없습니다.

Tasks

HallucinationLogical ReasoningRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Multi-Level Querying using A Knowledge Pyramid

2024-07-31 · Rubing Chen, Xulu Zhang, Jiaxin Wu, Wenqi Fan 외

This paper addresses the need for improved precision in existing Retrieval-Augmented Generation (RAG) methods that primarily focus on enhancing recall. We propose a multi-layer knowledge pyramid approach within the RAG f…

Knowledge GraphsRAGRetrievalRetrieval-augmented Generation

CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation

2025-03-25 · Nengbo Wang, Xiaotian Han, Jagdip Singh, Jing Ma 외

Large language models (LLMs) have revolutionized natural language processing (NLP), particularly through Retrieval-Augmented Generation (RAG), which enhances LLM capabilities by integrating external knowledge. However, t…

ChunkingRAGRetrievalRetrieval-augmented Generation+2

KBLaM: Knowledge Base augmented Language Model

2024-10-14 · Xi Wang, Liana Mikaelyan, Taketomo Isazawa, James Hensman

In this paper, we propose Knowledge Base augmented Language Model (KBLaM), a new method for augmenting Large Language Models (LLMs) with external knowledge. KBLaM works with a knowledge base (KB) constructed from a corpu…

8kGPUIn-Context LearningLanguage Modeling+6

Removal of Hallucination on Hallucination: Debate-Augmented RAG

2025-05-24 · Wentao Hu, WengYu Zhang, Yiyang Jiang, Chen Jason Zhang 외

Retrieval-Augmented Generation (RAG) enhances factual accuracy by integrating external knowledge, yet it introduces a critical issue: erroneous or biased retrieval can mislead generation, compounding hallucinations, a ph…

HallucinationRAGRetrievalRetrieval-augmented Generation

A Survey of Multimodal Retrieval-Augmented Generation

2025-03-26 · Lang Mei, Siyu Mo, Zhihan Yang, Chong Chen

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-onl…

Information RetrievalQuestion AnsweringRAGRetrieval+2