paper-with-me

Papers

WebFactory: Automated Compression of Foundational Language Intelligence into Grounded Web Agents

2026-03-05 · Sicheng Fan, Qingyun Shi, Shengze Xu, Shengbo Cai, Tieyong Zeng, Li Ling, Yanyi Shang, Dehan Kong arxiv

Current paradigms for training GUI agents are fundamentally limited by a reliance on either unsafe, non-reproducible live web interactions or costly, scarce human-crafted data and environments. We argue this focus on data volume overlooks a more critical factor: the efficiency of compressing a large language model's (LLM) latent knowledge into actionable agent behavior. We introduce WebFactory, a novel, fully automated closed-loop reinforcement learning pipeline for GUI agents, systematically compressing LLM-encoded internet intelligence into efficient, grounded actions. Our pipeline features a process of scalable environment synthesis, knowledge-aware task generation, LLM-powered trajectory collection, decomposed reward RL training, and systematic agent evaluation. Remarkably, our agent demonstrates exceptional data efficiency and generalization. Trained on synthetic data from only 10 websites within WebFactory, it achieves performance comparable to GUI agents trained on the same amount of human-annotated data from a much larger set of environments. This superior performance is consistent across our internal offline and online transfer benchmarks, where our agent also significantly outperforms the base foundation model. We further provide critical insights into the "embodiment potential" of different LLM foundations, offering a new axis for model evaluation. This work presents a scalable and cost-effective paradigm for transforming passive internet knowledge into active, grounded intelligence, marking a critical step towards general-purpose interactive agents.

📄 PDF Abstract BibTeX arXiv:2603.05044

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

Fictional Worldbuilding: Multi-Agent LLM Collaboration with Hierarchical Context Compression and Iterative Review

2026-07-10 · Jingbo Chen, He Wang, Wei Yuan, Yuqiao Lai 외 arxiv

Worldbuilding, the construction of coherent fictional worlds, is a foundational task in game design and literary creation. Large Language Models (LLMs) offer new possibilities for automated content generation, but their …

Compression Represents Intelligence Linearly

2024-04-15 · Yuzhen Huang, Jinghan Zhang, Zifei Shan, Junxian He

There is a belief that learning to compress well will lead to intelligence. Recently, language modeling has been shown to be equivalent to compression, which offers a compelling rationale for the success of large languag…

Language ModelingLanguage ModellingMathematical Reasoning

InVitroVision: a Multi-Modal AI Model for Automated Description of Embryo Development using Natural Language

2026-04-22 · Nicklas Neu, Thomas Ebner, Jasmin Primus, Raphael Zefferer 외 arxiv

The application of artificial intelligence (AI) in IVF has shown promise in improving consistency and standardization of decisions, but often relies on annotated data and does not make use of the multimodal nature of IVF…

Compression is Routing: Reconstruction Error as an Intrinsic Signal for Modular Language Models

2025-12-18 · Zhongpan Tang arxiv

Current Large Language Models (LLMs) face three major challenges: context length limitations, high inference costs, and catastrophic forgetting during continual learning. While Mixture-of-Experts (MoE) architectures miti…

Continual Learning

A Survey on Efficient Vision-Language-Action Models

2025-10-27 · Zhaoshu Yu, Bo Wang, Pengpeng Zeng, Haonan Zhang 외 arxiv

Vision-Language-Action models (VLAs) represent a significant frontier in embodied intelligence, aiming to bridge digital knowledge with physical-world interaction. Despite their remarkable performance, foundational VLAs …

Model Compression