paper-with-me

Papers

MM-BizRAG: Rethinking Multimodal Retrieval-Augmented Generation for General Purpose Enterprise Q&A

2026-06-02 · Hanoz Bhathena, Parin Rajesh Jhaveri, Rohan Mittal, Prateek Singh, Aymen Kallala, Rachneet Kaur, Yiqiao Jin, Zhen Zeng, Adwait Ratnaparkhi, Denis Kochedykov arxiv

Recent advances in multimodal retrieval-augmented generation (MM-RAG) have shifted toward minimal parsing, relying on page-level images for producing retriever embeddings and for answer generation. While efficient, this trend often neglects explicit handling of the rich, structured information in complex enterprise documents, instead depending on pre-trained embeddings or vision-language models to implicitly capture such structure. In this work, we take a more direct approach: MM-BizRAG proactively extracts and represents document structure via a document structure-aware split that dynamically routes documents through orientation-specific ingestion pipelines, applying explicit layout-aware parsing for vertically structured documents (e.g., reports) and holistic page-level representations for horizontally structured documents (e.g., slide decks). A unified LLM-driven artifact transformation pipeline with placeholder-based positional alignment preserves natural reading order, while inference-time multimodal assembly decouples retrieval representations from generation context, enabling richer, more grounded answers without any finetuning requirement. Through experiments on a large, heterogeneous enterprise dataset and two public benchmarks (SlideVQA and FinRAGBench-V), MM-BizRAG consistently outperforms state-of-the-art vision-centric baselines by up to 32% points, with especially strong gains on report-style layouts. Furthermore, we introduce FastRAGEval, a single-call LLM Judge metric for fine-grained generative recall that halves RAGChecker's cost while achieving stronger human alignment.

📄 PDF Abstract BibTeX arXiv:2606.04231

Code (0)

등록된 구현이 없습니다.

Tasks

Answer Generation

Similar Papers 제목 키워드 기반

Doc-REFRAG: Rethinking Multimodal Document Retrieval-Augmented Generation

2026-08-31 · Ruofan Hu, Shengyang Xu, Minjie Hong, Xiaoda Yang 외 arxiv

Real-world knowledge resides in multimodal documents, necessitating retrieval-augmented generation (RAG) for accurate question answering. However, existing multimodal RAG models are primarily designed for single-image or…

Question Answering

A Survey of Multimodal Retrieval-Augmented Generation

2025-03-26 · Lang Mei, Siyu Mo, Zhihan Yang, Chong Chen

Multimodal Retrieval-Augmented Generation (MRAG) enhances large language models (LLMs) by integrating multimodal data (text, images, videos) into retrieval and generation processes, overcoming the limitations of text-onl…

Information RetrievalQuestion AnsweringRAGRetrieval+2

MIRA: A Novel Framework for Fusing Modalities in Medical RAG

2025-07-10 · Jinhong Wang, Tajamul Ashraf, Zongyan Han, Jorma Laaksonen 외 arxiv

Multimodal Large Language Models (MLLMs) have significantly advanced AI-assisted medical diagnosis, but they often generate factually inconsistent responses that deviate from established medical knowledge. Retrieval-Augm…

Multimodal ReasoningMedical Diagnosis

Self-adaptive Multimodal Retrieval-Augmented Generation

2024-10-15 · Wenjia Zhai

Traditional Retrieval-Augmented Generation (RAG) methods are limited by their reliance on a fixed number of retrieved documents, often resulting in incomplete or noisy information that undermines task performance. Althou…

Image CaptioningRAGResponse GenerationRetrieval+1

Rethinking Retrieval-Augmented Generation as a Cooperative Decision-Making Problem

2026-02-21 · Lichang Song, Ting Long, Yi Chang arxiv

Retrieval-Augmented Generation (RAG) has demonstrated strong effectiveness in knowledge-intensive tasks by grounding language generation in external evidence. Despite its success, many existing RAG systems are built base…