paper-with-me

Papers

MMORE: Massive Multimodal Open RAG & Extraction

2025-09-15 · Alexandre Sallinen, Stefan Krsteski, Paul Teiletche, Marc-Antoine Allard, Baptiste Lecoeur, Michael Zhang, Fabrice Nemo, David Kalajdzic, Matthias Meyer, Mary-Anne Hartley arxiv

We introduce MMORE, an open-source pipeline for Massive Multimodal Open RetrievalAugmented Generation and Extraction, designed to ingest, transform, and retrieve knowledge from heterogeneous document formats at scale. MMORE supports more than fifteen file types, including text, tables, images, emails, audio, and video, and processes them into a unified format to enable downstream applications for LLMs. The architecture offers modular, distributed processing, enabling scalable parallelization across CPUs and GPUs. On processing benchmarks, MMORE demonstrates a 3.8-fold speedup over single-node baselines and 40% higher accuracy than Docling on scanned PDFs. The pipeline integrates hybrid dense-sparse retrieval and supports both interactive APIs and batch RAG endpoints. Evaluated on PubMedQA, MMORE-augmented medical LLMs improve biomedical QA accuracy with increasing retrieval depth. MMORE provides a robust, extensible foundation for deploying task-agnostic RAG systems on diverse, real-world multimodal data. The codebase is available at https://github.com/swiss-ai/mmore.

📄 PDF Abstract BibTeX arXiv:2509.11937

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Learning to Love Edge Cases in Formative Math Assessment: Using the AMMORE Dataset and Chain-of-Thought Prompting to Improve Grading Accuracy

2024-09-26 · Owen Henkel, Hannah Horne-Robinson, Maria Dyshel, Nabil Ch 외

This paper introduces AMMORE, a new dataset of 53,000 math open-response question-answer pairs from Rori, a learning platform used by students in several African countries and conducts two experiments to evaluate the use…

Knowledge TracingMath

Rethinking Early-Fusion Strategies for Improved Multimodal Image Segmentation

2025-01-19 · Zhengwen Shen, Yulian Li, Han Zhang, Yuchen Weng 외

RGB and thermal image fusion have great potential to exhibit improved semantic segmentation in low-illumination conditions. Existing methods typically employ a two-branch encoder framework for multimodal feature extracti…

DecoderImage SegmentationSegmentationSemantic Segmentation

MMAU: A Massive Multi-Task Audio Understanding and Reasoning Benchmark

2024-10-24 · S Sakshi, Utkarsh Tyagi, Sonal Kumar, Ashish Seth 외

The ability to comprehend audio--which includes speech, non-speech sounds, and music--is crucial for AI agents to interact effectively with the world. We present MMAU, a novel benchmark designed to evaluate multimodal au…

A Multimodal Text- and Graph-Based Approach for Open-Domain Event Extraction from Documents

2026-04-23 · Praval Sharma arxiv

Event extraction is essential for event understanding and analysis. It supports tasks such as document summarization and decision-making in emergency scenarios. However, existing event extraction approaches have limitati…

Document SummarizationEvent Extraction

Open Visual Knowledge Extraction via Relation-Oriented Multimodality Model Prompting

2023-10-28 · NeurIPS 2023 11

Images contain rich relational knowledge that can help machines understand the world. Existing methods on visual knowledge extraction often rely on the pre-defined format (e.g., sub-verb-obj tuples) or vocabulary (e.g., …

RelationVisual Reasoning