paper-with-me

홈 › Papers

An Empirical Study of Multi-Agent Collaboration for Automated Research

2026-03-31 · Yang Shen, Zhenyi Yi, Ziyi Zhao, Lijun Sun, Dongyang Li, Chin-Teng Lin, Yuhui Shi arxiv

As AI agents evolve, the community is rapidly shifting from single Large Language Models (LLMs) to Multi-Agent Systems (MAS) to overcome cognitive bottlenecks in automated research. However, the optimal multi-agent coordination framework for these autonomous agents remains largely unexplored. In this paper, we present a systematic empirical study investigating the comparative efficacy of distinct multi-agent structures for automated machine learning optimization. Utilizing a rigorously controlled, execution-based testbed equipped with Git worktree isolation and explicit global memory, we benchmark a single-agent baseline against two multi-agent paradigms: a subagent architecture (parallel exploration with post-hoc consolidation) and an agent team architecture (experts with pre-execution handoffs). By evaluating these systems under strictly fixed computational time budgets, our findings reveal a fundamental trade-off between operational stability and theoretical deliberation. The subagent mode functions as a highly resilient, high-throughput search engine optimal for broad, shallow optimizations under strict time constraints. Conversely, the agent team topology exhibits higher operational fragility due to multi-author code generation but achieves the deep theoretical alignment necessary for complex architectural refactoring given extended compute budgets. These empirical insights provide actionable guidelines for designing future autoresearch systems, advocating for dynamically routed architectures that adapt their collaborative structures to real-time task complexity.

📄 PDF Abstract BibTeX arXiv:2603.29632

Code (0)

등록된 구현이 없습니다.

Tasks

Code Generation

Similar Papers 제목 키워드 기반

A Sober Look at Agentic Misalignment in Automated Workflows

2026-05-22 · Wenqian Ye, Bo Yuan, Zhichao Xu, Yijun Tian 외 arxiv

We study a class of emergent misalignment in multi-agent systems (MAS), with a focus on automated workflows, which we refer to agentic misalignment. Although these systems can solve complex tasks, they often fail because…

Evaluating Generative Models as Interactive Emergent Representations of Human-Like Collaborative Behavior

2026-05-05 · Shinas Shaji, Teena Chakkalayil Hassan, Sebastian Houben, Alex Mitrevski arxiv

Human-AI collaboration requires AI agents to understand human behavior for effective coordination. While advances in foundation models show promising capabilities in understanding and showing human-like behavior, their a…

The Collaboration Gap

2025-11-04 · Tim R. Davidson, Adam Fourney, Saleema Amershi, Robert West 외 arxiv

The trajectory of AI development suggests that we will increasingly rely on agent-based systems composed of independently developed agents with different information, privileges, and tools. The success of these systems w…

ChatCollab: Exploring Collaboration Between Humans and AI Agents in Software Teams

2024-12-02 · Benjamin Klieger, Charis Charitsis, Miroslav Suzara, Sierra Wang 외

We explore the potential for productive team-based collaboration between humans and Artificial Intelligence (AI) by presenting and conducting initial tests with a general framework that enables multiple human and AI agen…

Towards Multi-Agent Reasoning Systems for Collaborative Expertise Delegation: An Exploratory Design Study

2025-05-12 · Baixuan Xu, Chunyang Li, Weiqi Wang, Wei Fan 외

Designing effective collaboration structure for multi-agent LLM systems to enhance collective reasoning is crucial yet remains under-explored. In this paper, we systematically investigate how collaborative reasoning perf…

Diversity