paper-with-me

홈 › Papers

Multi-Agent Computer Use

2026-06-01 · Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried arxiv

Computer use agents (CUAs) today are primarily deployed as single serial agents. This setup is suboptimal for complex long-horizon tasks that benefit from task decomposition, parallel execution, and consistent re-planning based on new information. In this paper, we argue that we should instead move towards evaluating and building multi-agent computer use (MACU) systems. These systems, which emphasize planning and parallel execution, alleviate many of the shortcomings of single-agent CUAs. We propose a general multi-agent setup in which a manager model decomposes computer use tasks as a directed acyclic graph (DAG), encoding relevant dependencies and goals for subagents. At each iteration, the manager dispatches parallel CUA subagents to carry out nodes on the ready frontier of the DAG, and continuously revises the DAG (adding, canceling, or rewriting nodes) as new findings arrive from subagents. This design treats the partially observable environment of computer use as a first class challenge: information that downstream agents may not be able to re-observe are retained and passed forward through the manager and DAG structure. We demonstrate that MACU consistently improves over strong single-agent baselines by $3.4-25.5\%$ on desktop (OSWorld) and web navigation (Online-Mind2Web, WebTailBench, Odysseys) benchmarks, exhibits more favorable test-time scaling, and solves complex long-horizon tasks where single-agent CUAs get stuck. On Odysseys, a long-horizon web navigation benchmark, MACU improves average task completion wall-clock time by ${\sim} 1.5 \times$, demonstrating its efficacy in speeding up traditionally slow CUA pipelines. Our findings highlight that multi-agent coordination is a promising axis for scaling computer use agents to work productively for longer and more effectively. We release all code and interactive visualizations at https://jykoh.com/multi-agent-computer-use.

📄 PDF Abstract BibTeX arXiv:2606.01533

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Agent S: An Open Agentic Framework that Uses Computers Like a Human

2024-10-10 · Saaket Agashe, Jiuzhou Han, Shuyu Gan, Jiachen Yang 외

We present Agent S, an open agentic framework that enables autonomous interaction with computers through a Graphical User Interface (GUI), aimed at transforming human-computer interaction by automating complex, multi-ste…

AI AgentTask Planning

ScreenAgent: A Vision Language Model-driven Computer Control Agent

2024-02-09 · Runliang Niu, Jindong Li, Shiqi Wang, Yali Fu 외

Existing Large Language Models (LLM) can invoke a variety of tools and APIs to complete complex tasks. The computer, as the most powerful and universal tool, could potentially be controlled directly by a trained LLM agen…

Language ModelingLanguage Modelling

OSWorld: Benchmarking Multimodal Agents for Open-Ended Tasks in Real Computer Environments

2024-04-11 · Tianbao Xie, Danyang Zhang, Jixuan Chen, Xiaochuan Li 외

Autonomous agents that accomplish complex computer tasks with minimal human interventions have the potential to transform human-computer interaction, significantly enhancing accessibility and productivity. However, exist…

Benchmarking

Multi-Agent Memory from a Computer Architecture Perspective: Visions and Challenges Ahead

2026-03-09 · Zhongming Yu, Naicheng Yu, Hejia Zhang, Wentao Ni 외 arxiv

As LLM agents evolve into collaborative multi-agent systems, their memory requirements grow rapidly in complexity. This position paper frames multi-agent memory as a computer architecture problem. We distinguish shared a…

InfantAgent-Next: A Multimodal Generalist Agent for Automated Computer Interaction

2025-05-16 · Bin Lei, Weitai Kang, Zijian Zhang, Winson Chen 외

This paper introduces \textsc{InfantAgent-Next}, a generalist agent capable of interacting with computers in a multimodal manner, encompassing text, images, audio, and video. Unlike existing approaches that either build …