paper-with-me

Papers

DuetRAG: Collaborative Retrieval-Augmented Generation

2024-05-12 · Dian Jiao, Li Cai, Jingsheng Huang, Wenqiao Zhang, Siliang Tang, Yueting Zhuang

Retrieval-Augmented Generation (RAG) methods augment the input of Large Language Models (LLMs) with relevant retrieved passages, reducing factual errors in knowledge-intensive tasks. However, contemporary RAG approaches suffer from irrelevant knowledge retrieval issues in complex domain questions (e.g., HotPot QA) due to the lack of corresponding domain knowledge, leading to low-quality generations. To address this issue, we propose a novel Collaborative Retrieval-Augmented Generation framework, DuetRAG. Our bootstrapping philosophy is to simultaneously integrate the domain fintuning and RAG models to improve the knowledge retrieval quality, thereby enhancing generation quality. Finally, we demonstrate DuetRAG' s matches with expert human researchers on HotPot QA.

📄 PDF Abstract BibTeX arXiv:2405.13002

Code (0)

등록된 구현이 없습니다.

Tasks

PhilosophyRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
WordPiece 설명 없음
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

ClusterRAG: Cluster-Based Collaborative Filtering for Personalized Retrieval-Augmented Generation

2026-04-14 · Gibson Nkhata, Uttamasha Anjally Oyshi, Quan Mai, Susan Gauch arxiv

Personalized Retrieval-Augmented Generation (RAG) relies on accurately selecting user-relevant documents. In practice, existing RAG approaches often suffer from high retrieval costs and overlook that collaborative signal…

Collaborative Filtering

Personalizing Student-Agent Interactions Using Log-Contextualized Retrieval Augmented Generation (RAG)

2025-05-22 · Clayton Cohn, Surya Rayala, Caitlin Snyder, Joyce Fonteles 외

Collaborative dialogue offers rich insights into students' learning and critical thinking. This is essential for adapting pedagogical agents to students' learning and problem-solving skills in STEM+C settings. While larg…

Decision MakingRAGRetrievalRetrieval-augmented Generation

Retrieval Augmented Generation with Collaborative Filtering for Personalized Text Generation

2025-04-08 · Teng Shi, Jun Xu, Xiao Zhang, Xiaoxue Zang 외

Recently, the personalization of Large Language Models (LLMs) to generate content that aligns with individual user preferences has garnered widespread attention. Personalized Retrieval-Augmented Generation (RAG), which r…

Collaborative FilteringContrastive LearningRAGRecommendation Systems+4

CoRAG: Collaborative Retrieval-Augmented Generation

2025-04-02 · Aashiq Muhamed, Mona Diab, Virginia Smith

Retrieval-Augmented Generation (RAG) models excel in knowledge-intensive tasks, especially under few-shot learning constraints. We introduce CoRAG, a framework extending RAG to collaborative settings, where clients joint…

Few-Shot LearningOpen-Domain Question AnsweringQuestion AnsweringRAG+2

AffectAgent: Collaborative Multi-Agent Reasoning for Retrieval-Augmented Multimodal Emotion Recognition

2026-04-14 · Zeheng Wang, Zitong Yu, Yijie Zhu, Bo Zhao 외 arxiv

LLM-based multimodal emotion recognition relies on static parametric memory and often hallucinates when interpreting nuanced affective states. In this paper, given that single-round retrieval-augmented generation is high…

Multimodal Emotion Recognition