paper-with-me

Papers

CausalRAG: Integrating Causal Graphs into Retrieval-Augmented Generation

2025-03-25 · Nengbo Wang, Xiaotian Han, Jagdip Singh, Jing Ma, Vipin Chaudhary

Large language models (LLMs) have revolutionized natural language processing (NLP), particularly through Retrieval-Augmented Generation (RAG), which enhances LLM capabilities by integrating external knowledge. However, traditional RAG systems face critical limitations, including disrupted contextual integrity due to text chunking, and over-reliance on semantic similarity for retrieval. To address these issues, we propose CausalRAG, a novel framework that incorporates causal graphs into the retrieval process. By constructing and tracing causal relationships, CausalRAG preserves contextual continuity and improves retrieval precision, leading to more accurate and interpretable responses. We evaluate CausalRAG against regular RAG and graph-based RAG approaches, demonstrating its superiority across several metrics. Our findings suggest that grounding retrieval in causal reasoning provides a promising approach to knowledge-intensive tasks.

📄 PDF Abstract BibTeX arXiv:2503.19878

Code (0)

등록된 구현이 없습니다.

Tasks

ChunkingRAGRetrievalRetrieval-augmented GenerationSemantic SimilaritySemantic Textual Similarity

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BART BART is a denoising autoencoder for pretraining sequence-to-sequence models. It is trained by (1) corrupting text…
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…

Similar Papers 제목 키워드 기반

CausalRAG2: Hierarchical Causal Knowledge Graph Design for RAG

2026-02-04 · Nengbo Wang, Tuo Liang, Vikash Singh, Chaoda Song 외 arxiv

Retrieval augmented generation (RAG) has enhanced large language models by enabling access to external knowledge, with graph-based RAG emerging as a powerful paradigm for structured retrieval and reasoning. However, exis…

Knowledge Graphs

Beyond the Parameters: A Technical Survey of Contextual Enrichment in Large Language Models: From In-Context Prompting to Causal Retrieval-Augmented Generation

2026-04-03 · Prakhar Bansal, Shivangi Agarwal arxiv

Large language models (LLMs) encode vast world knowledge in their parameters, yet they remain fundamentally limited by static knowledge, finite context windows, and weakly structured causal reasoning. This survey provide…

Prompt Engineering

Causal-Counterfactual RAG: The Integration of Causal-Counterfactual Reasoning into RAG

2025-09-17 · Harshad Khadilkar, Abhay Gupta arxiv

Large language models (LLMs) have transformed natural language processing (NLP), enabling diverse applications by integrating large-scale pre-trained knowledge. However, their static knowledge limits dynamic reasoning ov…

Semantic Similarity

Causal-Enhanced AI Agents for Medical Research Screening

2026-01-06 · Duc Ngo, Arya Rahgoza arxiv

Systematic reviews are essential for evidence-based medicine, but reviewing 1.5 million+ annual publications manually is infeasible. Current AI approaches suffer from hallucinations in systematic review tasks, with studi…

Knowledge Graphs

Causal Graphs Meet Thoughts: Enhancing Complex Reasoning in Graph-Augmented LLMs

2025-01-24 · Hang Luo, Jian Zhang, Chujun Li

In knowledge-intensive tasks, especially in high-stakes domains like medicine and law, it is critical not only to retrieve relevant information but also to provide causal reasoning and explainability. Large language mode…

Knowledge GraphsMedical Question AnsweringNatural Language UnderstandingQuestion Answering+5