paper-with-me

홈 › Papers

Diagnosing Failure Modes of Shared-State Collaboration in Resource-Constrained Visual Agents

2026-05-29 · Yunpeng Zhou arxiv

Modular visual reasoning systems increasingly rely on shared working memory for multi-step collaboration, yet the failure dynamics of intermediate state evolution in low-capacity regimes remain underexplored. We study failure modes of collaborative reasoning with weak learners (4B--8B models) through the lens of noise accumulation. We introduce CoSee, an auditing framework that formalizes the read-write-verify loop to trace information flow in document visual question answering. Across multi-page, chart, and web-based benchmarks, we find a counter-intuitive degradation: naive shared workspaces often amplify hallucinations rather than resolve them. We identify two dominant failure modes: Noise Reinforcement, where ungrounded notes are reused as evidence, and Policy Collapse, where added context shifts the model toward under-specified, short-form answers. Using cost-accuracy Pareto frontiers, we show that increased compute can correlate negatively with performance without explicit verification. Our findings suggest that for resource-constrained agents, the bottleneck lies not in reasoning depth but in communication fidelity, providing trace-level diagnostics and a mechanistic baseline for reliable modular design.

📄 PDF Abstract BibTeX arXiv:2605.31354

Code (0)

등록된 구현이 없습니다.

Tasks

Visual Question AnsweringVisual Reasoning

Similar Papers 제목 키워드 기반

MTAVG-Bench 2.0: Diagnosing Failure Modes of Cinematic Expressiveness in Multi-Talker Audio-Video Generation

2026-05-27 · Haitian Li, Yanghao Zhou, Heyan Huang, Liangji Chen 외 arxiv

In recent years, Multi-Talker Audio-Video Generation (MTAVG) models have shown promising performance on fundamental metrics such as lip-sync and audio-visual alignment. However, these metrics remain insufficient for asse…

Video Generation

AgentWorld: Benchmarking Long-Horizon Collaboration of Multi-agent LLMs

2026-09-25 · Raphael Shu, Yusen Zhang, Young Min Cho, Jin Mo Yang 외 hf

Existing multi-agent benchmarks primarily test in competitive settings, short-horizon interactions under 20 steps, or simply aggregate individual performance, failing to isolate and highlight genuine collaboration capabi…

A Forensic Analysis of Synthetic Data in RL: Diagnosing and Solving Algorithmic Failures in Model-Based Policy Optimization

2025-10-01 · Brett Barkley, David Fridovich-Keil arxiv

Synthetic data is central to data-efficient Dyna-style model-based reinforcement learning, but it can also degrade performance. We study this failure in Model-Based Policy Optimization (MBPO), which performs actor-critic…

Reinforcement LearningContinuous ControlOpenAI Gym

3DPFIX: Improving Remote Novices' 3D Printing Troubleshooting through Human-AI Collaboration

2024-01-29 · Nahyun Kwon, Tong Sun, Yuyang Gao, Liang Zhao 외

The widespread consumer-grade 3D printers and learning resources online enable novices to self-train in remote settings. While troubleshooting plays an essential part of 3D printing, the process remains challenging for m…

Territory Paint Wars: Diagnosing and Mitigating Failure Modes in Competitive Multi-Agent PPO

2026-04-04 · Diyansha Singh arxiv

We present Territory Paint Wars, a minimal competitive multi-agent reinforcement learning environment implemented in Unity, and use it to systematically investigate failure modes of Proximal Policy Optimisation (PPO) und…

Multi-agent Reinforcement Learning