paper-with-me

홈 › Papers

Hypercube-RAG: Hypercube-Based Retrieval-Augmented Generation for In-domain Scientific Question-Answering

2025-05-25 · Jimeng Shi, Sizhe Zhou, Bowen Jin, Wei Hu, Shaowen Wang, Giri Narasimhan, Jiawei Han

Large language models (LLMs) often need to incorporate external knowledge to solve theme-specific problems. Retrieval-augmented generation (RAG), which empowers LLMs to generate more qualified responses with retrieved external data and knowledge, has shown its high promise. However, traditional semantic similarity-based RAGs struggle to return concise yet highly relevant information for domain knowledge-intensive tasks, such as scientific question-answering (QA). Built on a multi-dimensional (cube) structure called Hypercube, which can index documents in an application-driven, human-defined, multi-dimensional space, we introduce the Hypercube-RAG, a novel RAG framework for precise and efficient retrieval. Given a query, Hypercube-RAG first decomposes it based on its entities and topics and then retrieves relevant documents from cubes by aligning these decomposed components with hypercube dimensions. Experiments on three in-domain scientific QA datasets demonstrate that our method improves accuracy by 3.7% and boosts retrieval efficiency by 81.2%, measured as relative gains over the strongest RAG baseline. More importantly, our Hypercube-RAG inherently offers explainability by revealing the underlying predefined hypercube dimensions used for retrieval. The code and data sets are available at https://github.com/JimengShi/Hypercube-RAG.

📄 PDF Abstract BibTeX arXiv:2505.19288

Code (1)

jimengshi/hypercube-rag 공식 구현

Tasks

Question AnsweringRAGRetrievalRetrieval-augmented GenerationSemantic SimilaritySemantic Textual Similarity

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
WordPiece 설명 없음
Weight Decay 설명 없음
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Compact Hypercube Embeddings for Fast Text-based Wildlife Observation Retrieval

2026-01-30 · Ilyass Moummad, Marius Miron, David Robinson, Kawtar Zaher 외 arxiv

Large-scale biodiversity monitoring platforms increasingly rely on multimodal wildlife observations. While recent foundation models enable rich semantic representations across vision, audio, and language, retrieving rele…

parameter-efficient fine-tuningZero-shot GeneralizationImage Retrieval

A Note on Small Percolating Sets on Hypercubes via Generative AI

2024-11-29 · Gergely Bérczi, Adam Zsolt Wagner

We apply a generative AI pattern-recognition technique called PatternBoost to study bootstrap percolation on hypercubes. With this, we slightly improve the best existing upper bound for the size of percolating subsets of…

Slicing the hypercube is not easy

2021-02-10 · Gal Yehuda, Amir Yehudayoff

We prove that at least $\Omega(n^{0.51})$ hyperplanes are needed to slice all edges of the $n$-dimensional hypercube. We provide a couple of applications: lower bounds on the computational complexity of parity, and a low…

Fourier Analysis on the Boolean Hypercube via Hoeffding Functional Decomposition

2025-10-08 · Baptiste Ferrere, Nicolas Bousquet, Fabrice Gamboa, Jean-Michel Loubes 외 arxiv

Fourier analysis on the Boolean hypercube is fundamentally defined as the orthogonal decomposition of the space of pseudo-Boolean functions with respect to the uniform probability measure. In this work, we propose an ANO…

Thinking inside The Box: Learning Hypercube Representations for Group Recommendation

2022-04-06 · Tong Chen, Hongzhi Yin, Jing Long, Quoc Viet Hung Nguyen 외

As a step beyond traditional personalized recommendation, group recommendation is the task of suggesting items that can satisfy a group of users. In group recommendation, the core is to design preference aggregation func…

Decision Making