paper-with-me

Papers

Know3-RAG: A Knowledge-aware RAG Framework with Adaptive Retrieval, Generation, and Filtering

2025-05-19 · Xukai Liu, Ye Liu, Shiwen Wu, Yanghai Zhang, Yihao Yuan, Kai Zhang, Qi Liu

Recent advances in large language models (LLMs) have led to impressive progress in natural language generation, yet their tendency to produce hallucinated or unsubstantiated content remains a critical concern. To improve factual reliability, Retrieval-Augmented Generation (RAG) integrates external knowledge during inference. However, existing RAG systems face two major limitations: (1) unreliable adaptive control due to limited external knowledge supervision, and (2) hallucinations caused by inaccurate or irrelevant references. To address these issues, we propose Know3-RAG, a knowledge-aware RAG framework that leverages structured knowledge from knowledge graphs (KGs) to guide three core stages of the RAG process, including retrieval, generation, and filtering. Specifically, we introduce a knowledge-aware adaptive retrieval module that employs KG embedding to assess the confidence of the generated answer and determine retrieval necessity, a knowledge-enhanced reference generation strategy that enriches queries with KG-derived entities to improve generated reference relevance, and a knowledge-driven reference filtering mechanism that ensures semantic alignment and factual accuracy of references. Experiments on multiple open-domain QA benchmarks demonstrate that Know3-RAG consistently outperforms strong baselines, significantly reducing hallucinations and enhancing answer reliability.

📄 PDF Abstract BibTeX arXiv:2505.12662

Code (1)

laquabe/know3rag 공식 구현 pytorch

Tasks

Knowledge GraphsRAGRetrievalRetrieval-augmented GenerationText Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
WordPiece 설명 없음
Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

SeaKR: Self-aware Knowledge Retrieval for Adaptive Retrieval Augmented Generation

2024-06-27 · Zijun Yao, Weijian Qi, Liangming Pan, Shulin Cao 외

This paper introduces Self-aware Knowledge Retrieval (SeaKR), a novel adaptive RAG model that extracts self-aware uncertainty of LLMs from their internal states. SeaKR activates retrieval when the LLMs present high self-…

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Reinforced Internal-External Knowledge Synergistic Reasoning for Efficient Adaptive Search Agent

2025-05-12 · Ziyang Huang, Xiaowei Yuan, Yiming Ju, Jun Zhao 외

Retrieval-augmented generation (RAG) is a common strategy to reduce hallucinations in Large Language Models (LLMs). While reinforcement learning (RL) can enable LLMs to act as search agents by activating retrieval capabi…

RAGReinforcement Learning (RL)RetrievalRetrieval-augmented Generation

LLandMark: A Multi-Agent Framework for Landmark-Aware Multimodal Interactive Video Retrieval

2026-03-03 · Minh-Chi Phung, Thien-Bao Le, Cam-Tu Tran-Thi, Thu-Dieu Nguyen-Thi 외 arxiv

The increasing diversity and scale of video data demand retrieval systems capable of multimodal understanding, adaptive reasoning, and domain-specific knowledge integration. This paper presents LLandMark, a modular multi…

Video Retrieval

FlexStructRAG: Flexible Structure-Aware Multi-Granular Relational Retrieval for RAG

2026-02-01 · Mengzhu Chen, Haodong Yang, Jia Cai, Xiaolin Huang arxiv

Retrieval-Augmented Generation (RAG) systems critically depend on how external knowledge is segmented, structured, and retrieved. Most existing approaches either retrieve fixed-length text chunks, which fragments discour…

SAKE: Self-aware Knowledge Exploitation-Exploration for Grounded Multimodal Named Entity Recognition

2026-04-22 · Jielong Tang, Xujie Yuan, Jiayang Liu, Jianxing Yu 외 arxiv

Grounded Multimodal Named Entity Recognition (GMNER) aims to extract named entities and localize their visual regions within image-text pairs, serving as a pivotal capability for various downstream applications. In open-…

Grounded Multimodal Named Entity RecognitionReinforcement Learning