paper-with-me

Papers

ORCA: Orchestrated Reasoning with Collaborative Agents for Document Visual Question Answering

2026-03-02 · Aymen Lassoued, Mohamed Ali Souibgui, Yousri Kessentini arxiv

Document Visual Question Answering (DocVQA) remains challenging for existing Vision-Language Models (VLMs), especially under complex reasoning and multi-step workflows. Current approaches struggle to decompose intricate questions into manageable sub-tasks and often fail to leverage specialized processing paths for different document elements. We present ORCA: Orchestrated Reasoning with Collaborative Agents for Document Visual Question Answering, a novel multi-agent framework that addresses these limitations through strategic agent coordination and iterative refinement. ORCA begins with a reasoning agent that decomposes queries into logical steps, followed by a routing mechanism that activates task-specific agents from a specialized agent dock. Our framework leverages a set of specialized AI agents, each dedicated to a distinct modality, enabling fine-grained understanding and collaborative reasoning across diverse document components. To ensure answer reliability, ORCA employs a debate mechanism with stress-testing, and when necessary, a thesis-antithesis adjudication process. This is followed by a sanity checker to ensure format consistency. Extensive experiments on three benchmarks demonstrate that our approach achieves significant improvements over state-of-the-art methods, establishing a new paradigm for collaborative agent systems in vision-language reasoning.

📄 PDF Abstract BibTeX arXiv:2603.02438

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Question Answering

Similar Papers 제목 키워드 기반

Scaling Large Language Model-based Multi-Agent Collaboration

2024-06-11 · Chen Qian, Zihao Xie, Yifei Wang, Wei Liu 외

Recent breakthroughs in large language model-driven autonomous agents have revealed that multi-agent collaboration often surpasses each individual through collective reasoning. Inspired by the neural scaling law--increas…

Language ModelingLanguage ModellingLarge Language Modelmodel

FORGE: Research-Trajectory Hijacking Attacks on Deep Research Agents

2026-07-06 · Yue Pan, Ziheng Zhang, Junxiang Lei, Changhao Jia 외 arxiv

Deep research agents decompose open-ended queries into subtasks, retrieve web evidence over multiple rounds, and synthesize long-form reports. This workflow creates a planning-layer poisoning surface: adversarial documen…

ORCA-bench: How Ready Are Language Model Agents for Oncall?

2026-07-30 · Albert Gong, Kyuseong Choi, Abhineet Agarwal, Jason Schechner 외 arxiv

Large language models can write, patch, and search code, but oncall root cause analysis (RCA) demands something different: reasoning over noisy metrics, logs, traces, and source code, starting from ambiguous user-facing …

CXRAgent: Director-Orchestrated Multi-Stage Reasoning for Chest X-Ray Interpretation

2025-10-24 · Jinhui Lou, Yan Yang, Zhou Yu, Zhenqi Fu 외 arxiv

Chest X-ray (CXR) plays a pivotal role in clinical diagnosis, and a variety of task-specific and foundation models have been developed for automatic CXR interpretation. However, these models often struggle to adapt to ne…

OPERA: A Reinforcement Learning--Enhanced Orchestrated Planner-Executor Architecture for Reasoning-Oriented Multi-Hop Retrieval

2025-08-22 · Yu Liu, Yanbing Liu, Fangfang Yuan, Cong Cao 외 arxiv

Recent advances in large language models (LLMs) and dense retrievers have driven significant progress in retrieval-augmented generation (RAG). However, existing approaches face significant challenges in complex reasoning…

Reinforcement Learning