paper-with-me

Papers

HybGRAG: Hybrid Retrieval-Augmented Generation on Textual and Relational Knowledge Bases

2024-12-20 · Meng-Chieh Lee, Qi Zhu, Costas Mavromatis, Zhen Han, Soji Adeshina, Vassilis N. Ioannidis, Huzefa Rangwala, Christos Faloutsos

Given a semi-structured knowledge base (SKB), where text documents are interconnected by relations, how can we effectively retrieve relevant information to answer user questions? Retrieval-Augmented Generation (RAG) retrieves documents to assist large language models (LLMs) in question answering; while Graph RAG (GRAG) uses structured knowledge bases as its knowledge source. However, many questions require both textual and relational information from SKB - referred to as "hybrid" questions - which complicates the retrieval process and underscores the need for a hybrid retrieval method that leverages both information. In this paper, through our empirical analysis, we identify key insights that show why existing methods may struggle with hybrid question answering (HQA) over SKB. Based on these insights, we propose HybGRAG for HQA consisting of a retriever bank and a critic module, with the following advantages: (1) Agentic, it automatically refines the output by incorporating feedback from the critic module, (2) Adaptive, it solves hybrid questions requiring both textual and relational information with the retriever bank, (3) Interpretable, it justifies decision making with intuitive refinement path, and (4) Effective, it surpasses all baselines on HQA benchmarks. In experiments on the STaRK benchmark, HybGRAG achieves significant performance gains, with an average relative improvement in Hit@1 of 51%.

📄 PDF Abstract BibTeX arXiv:2412.16311

Code (0)

등록된 구현이 없습니다.

Tasks

Question AnsweringRAGRetrievalRetrieval-augmented Generation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Adam 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
WordPiece 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

Leveraging In-Context Learning and Retrieval-Augmented Generation for Automatic Question Generation in Educational Domains

2025-01-29 · Subhankar Maity, Aniket Deroy, Sudeshna Sarkar

Question generation in education is a time-consuming and cognitively demanding task, as it requires creating questions that are both contextually relevant and pedagogically sound. Current automated question generation me…

In-Context LearningQuestion GenerationQuestion-GenerationRAG+2

CG-RAG: Research Question Answering by Citation Graph Retrieval-Augmented LLMs

2025-01-25 · Yuntong Hu, Zhihan Lei, Zhongjie Dai, Allen Zhang 외

Research question answering requires accurate retrieval and contextual understanding of scientific literature. However, current Retrieval-Augmented Generation (RAG) methods often struggle to balance complex document rela…

Information RetrievalQuestion AnsweringRAGRetrieval+1

From Retrieval to Generation: Comparing Different Approaches

2025-02-27 · Abdelrahman Abdallah, Jamshid Mozafari, Bhawna Piryani, Mohammed Ali 외

Knowledge-intensive tasks, particularly open-domain question answering (ODQA), document reranking, and retrieval-augmented language modeling, require a balance between retrieval accuracy and generative flexibility. Tradi…

Language ModelingLanguage ModellingOpen-Domain Question AnsweringPassage Retrieval+4

HyPA-RAG: A Hybrid Parameter Adaptive Retrieval-Augmented Generation System for AI Legal and Policy Applications

2024-08-29 · Rishi Kalra, Zekun Wu, Ayesha Gulley, Airlie Hilliard 외

Large Language Models (LLMs) face limitations in AI legal and policy applications due to outdated knowledge, hallucinations, and poor reasoning in complex contexts. Retrieval-Augmented Generation (RAG) systems address th…

Question AnsweringRAGRetrievalRetrieval-augmented Generation+1

Enhancing Retrieval-Augmented Generation with Topic-Enriched Embeddings: A Hybrid Approach Integrating Traditional NLP Techniques

2025-12-31 · Rodrigo Kataishi arxiv

Retrieval-augmented generation (RAG) systems rely on accurate document retrieval to ground large language models (LLMs) in external knowledge, yet retrieval quality often degrades in corpora where topics overlap and them…

Dimensionality Reduction