paper-with-me

Papers

Beyond Browsing: API-Based Web Agents

2024-10-21 · Yueqi Song, Frank Xu, Shuyan Zhou, Graham Neubig

Web browsers are a portal to the internet, where much of human activity is undertaken. Thus, there has been significant research work in AI agents that interact with the internet through web browsing. However, there is also another interface designed specifically for machine interaction with online content: application programming interfaces (APIs). In this paper we ask -- what if we were to take tasks traditionally tackled by Browsing Agents, and give AI agents access to APIs? To do so, we propose two varieties of agents: (1) an API-calling agent that attempts to perform online tasks through APIs only, similar to traditional coding agents, and (2) a Hybrid Agent that can interact with online data through both web browsing and APIs. In experiments on WebArena, a widely-used and realistic benchmark for web navigation tasks, we find that API-Based Agents outperform web Browsing Agents. Hybrid Agents out-perform both others nearly uniformly across tasks, resulting in a more than 24.0% absolute improvement over web browsing alone, achieving a success rate of 38.9%, the SOTA performance among task-agnostic agents. These results strongly suggest that when APIs are available, they present an attractive alternative to relying on web browsing alone.

📄 PDF Abstract BibTeX arXiv:2410.16464

Code (1)

yueqis/api-based-agent 공식 구현

Similar Papers 제목 키워드 기반

WebChoreArena: Evaluating Web Browsing Agents on Realistic Tedious Web Tasks

2025-06-02 · Atsuyuki Miyai, Zaiying Zhao, Kazuki Egashira, Atsuki Sato 외

Powered by a large language model (LLM), a web browsing agent operates web browsers in a human-like manner and offers a highly transparent path toward automating a wide range of everyday tasks. As web agents become incre…

Large Language ModelMathematical Reasoning

WebCoach: Self-Evolving Web Agents with Cross-Session Memory Guidance

2025-11-17 · Genglin Liu, Shijie Geng, Sha Li, Hejie Cui 외 arxiv

Multimodal LLM-powered agents have recently demonstrated impressive capabilities in web navigation, enabling agents to complete complex browsing tasks across diverse domains. However, current agents struggle with repetit…

Continual Learning

Coding Agents with Multimodal Browsing are Generalist Problem Solvers

2025-06-03 · Aditya Bharat Soni, Boxuan Li, Xingyao Wang, Valerie Chen 외

Modern human labor is characterized by specialization; we train for years and develop particular tools that allow us to perform well across a variety of tasks. In addition, AI agents have been specialized for domains suc…

Interaction-Driven Browsing: A Human-in-the-Loop Conceptual Framework Informed by Human Web Browsing for Browser-Using Agents

2025-09-15 · Hyeonggeun Yun, Jinkyu Jang arxiv

Although browser-using agents (BUAs) show promise for web tasks and automation, most BUAs terminate after executing a single instruction, failing to support users' complex, nonlinear browsing with ambiguous goals, iterat…

BrowseComp-$V^3$: A Visual, Vertical, and Verifiable Benchmark for Multimodal Browsing Agents

2026-02-13 · Huanyao Zhang, Jiepeng Zhou, Bo Li, Bowen Zhou 외 arxiv

Multimodal large language models (MLLMs), equipped with increasingly advanced planning and tool-use capabilities, are evolving into autonomous agents capable of performing multimodal web browsing and deep search in open-…