paper-with-me

홈 › Papers

Scaling Agents for Computer Use

2025-10-02 · Gonzalo Gonzalez-Pumariega, Vincent Tu, Chih-Lun Lee, Jiachen Yang, Ang Li, Xin Eric Wang arxiv

Computer-use agents (CUAs) hold promise for automating everyday digital tasks, but their performance on long-horizon, complex problems remains unreliable. Single-rollout execution is brittle, with small errors compounding over time and leading to high variance in outcomes. While prior work has attempted to scale within a single rollout, such approaches have yielded limited gains. Scaling over multiple rollouts offers a more promising alternative but doing so effectively is challenging due to the difficulty of evaluating and selecting among long-horizon agent behaviors. We introduce Behavior Judge (BJudge), which addresses this challenge by representing agent executions as behavior narratives and comparing candidate behaviors at this level, substantially improving robustness and success rates. Using multiple rollouts, BJudge establishes a new state of the art (SoTA) in OSWorld at 72.6%, significantly outperforming prior methods and surpassing human-level performance at 72.36%, with comprehensive ablations validating key design choices. We further demonstrate strong generalization results to different operating systems on WindowsAgentArena and AndroidWorld. Crucially, our results highlight the strong effectiveness of scaling CUAs, when you do it right: effective scaling requires structured trajectory understanding and selection, and BJudge provides a practical framework to achieve this.

📄 PDF Abstract BibTeX arXiv:2510.02250

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

ScaleCUA: Scaling Open-Source Computer Use Agents with Cross-Platform Data

2025-09-18 · Zhaoyang Liu, Jingjing Xie, Zichen Ding, Zehao Li 외 arxiv

Vision-Language Models (VLMs) have enabled computer use agents (CUAs) that operate GUIs autonomously, showing great potential, yet progress is limited by the lack of large-scale, open-source computer use data and foundat…

Rethinking Inference-Time Scaling in Local Computer-Use Agents: Failure Modes and Compute Tradeoffs

2026-07-30 · Woongkyu Lee, Jungwook Choi arxiv

Deploying autonomous computer-use agents (CUAs) locally is increasingly important for privacy, cost efficiency, and practical usability, yet improving their performance under strict hardware constraints remains challengi…

ComputerRL: Scaling End-to-End Online Reinforcement Learning for Computer Use Agents

2025-08-19 · Hanyu Lai, Xiao Liu, Yanxiao Zhao, Han Xu 외 arxiv

We introduce ComputerRL, a framework for autonomous desktop intelligence that enables agents to operate complex digital workspaces skillfully. ComputerRL features the API-GUI paradigm, which unifies programmatic API call…

Reinforcement Learning

Multi-Agent Computer Use

2026-06-01 · Jing Yu Koh, Ruslan Salakhutdinov, Daniel Fried arxiv

Computer use agents (CUAs) today are primarily deployed as single serial agents. This setup is suboptimal for complex long-horizon tasks that benefit from task decomposition, parallel execution, and consistent re-plannin…

Scaling Synthetic Task Generation for Agents via Exploration

2025-09-29 · Ram Ramrakhya, Andrew Szot, Omar Attia, Yuhao Yang 외 arxiv

Post-Training Multimodal Large Language Models (MLLMs) to build interactive agents holds promise across domains such as computer-use, web navigation, and robotics. A key challenge in scaling such post-training is lack of…

Reinforcement Learning