paper-with-me

홈 › Papers

MAVIS: Multi-Agent Video Retrieval via Structured Video Understanding

2026-06-08 · Jie Zhang, Qilang Ye, Hao Zhou, Haochen Liang, Fei Luo arxiv

The dominant paradigm in video retrieval relies on embedding-based full-corpus scanning, which suffers from inherent computational inefficiency and the semantic asymmetry between information-dense videos and sparse textual queries. To bridge this gap, we introduce \textbf{MAVIS}, a novel multi-agent framework that rethinks retrieval as cooperative reasoning rather than brute-force search. MAVIS first bridges the granularity mismatch by parsing raw videos into a \textbf{Structured Semantic Library}, enabling explicit attribute-level indexing. During retrieval, a planner decomposes complex user intents into atomic sub-tasks, dispatching specialized agents to independently nominate candidates. Crucially, MAVIS employs a \textbf{Logic-aware Debate} mechanism with a strict veto protocol, where agents collaboratively prune logical mismatches to identify a compact set of ``controversial'' candidates for fine-grained verification. This agentic workflow effectively bypasses the inefficiency of full-library traversal. Extensive experiments on MSR-VTT, MSVD, and ActivityNet demonstrate that MAVIS achieves competitive performance without task-specific fine-tuning, offering a scalable and interpretable alternative to traditional dual-encoder approaches.

📄 PDF Abstract BibTeX arXiv:2606.09641

Code (0)

등록된 구현이 없습니다.

Tasks

Video Retrieval

Similar Papers 제목 키워드 기반

MAViS: A Multi-Agent Framework for Long-Sequence Video Storytelling

2025-08-11 · Qian Wang, Ziqi Huang, Ruoxi Jia, Paul Debevec 외 arxiv

Despite recent advances, long-sequence video generation frameworks still suffer from significant limitations: poor assistive capability, suboptimal visual quality, and limited expressiveness. To mitigate these limitation…

Visual StorytellingAudio GenerationVideo Generation

QMAVIS: Long Video-Audio Understanding using Fusion of Large Multimodal Models

2026-01-10 · Zixing Lin, Jiale Wang, Gee Wah Ng, Lee Onn Mak 외 arxiv

Large Multimodal Models (LMMs) for video-audio understanding have traditionally been evaluated only on shorter videos of a few minutes long. In this paper, we introduce QMAVIS (Q Team-Multimodal Audio Video Intelligent S…

Speech Recognition

MAviS: A Multimodal Conversational Assistant For Avian Species

2026-03-07 · Yevheniia Kryklyvets, Mohammed Irfan Kurpath, Sahal Shaji Mullappilly, Jinxing Zhou 외 arxiv

Fine-grained understanding and species-specific multimodal question answering are vital for advancing biodiversity conservation and ecological monitoring. However, existing multimodal large language models face challenge…

Question Answering

MAVIS: Mathematical Visual Instruction Tuning with an Automatic Data Engine

2024-07-11 · Renrui Zhang, Xinyu Wei, Dongzhi Jiang, Ziyu Guo 외

The mathematical capabilities of Multi-modal Large Language Models (MLLMs) remain under-explored with three areas to be improved: visual encoding of math diagrams, diagram-language alignment, and chain-of-thought (CoT) r…

Contrastive LearningLanguage ModellingLarge Language ModelMath+2

MAVIS: Multi-Objective Alignment via Inference-Time Value-Guided Selection

2025-08-19 · Jeremy Carleton, Debajoy Mukherjee, Srinivas Shakkottai, Dileep Kalathil arxiv

Large Language Models (LLMs) are increasingly deployed across diverse applications that demand balancing multiple, often conflicting, objectives -- such as helpfulness, harmlessness, or humor. Many traditional methods fo…