WorkForceAgent-R1: Incentivizing Reasoning Capability in LLM-based Web Agents via Reinforcement Learning

2025-05-28 · Yuchen Zhuang, Di Jin, Jiaao Chen, Wenqi Shi, Hanrui Wang, Chao Zhang

Large language models (LLMs)-empowered web agents enables automating complex, real-time web navigation tasks in enterprise environments. However, existing web agents relying on supervised fine-tuning (SFT) often struggle with generalization and robustness due to insufficient reasoning capabilities when handling the inherently dynamic nature of web interactions. In this study, we introduce WorkForceAgent-R1, an LLM-based web agent trained using a rule-based R1-style reinforcement learning framework designed explicitly to enhance single-step reasoning and planning for business-oriented web navigation tasks. We employ a structured reward function that evaluates both adherence to output formats and correctness of actions, enabling WorkForceAgent-R1 to implicitly learn robust intermediate reasoning without explicit annotations or extensive expert demonstrations. Extensive experiments on the WorkArena benchmark demonstrate that WorkForceAgent-R1 substantially outperforms SFT baselines by 10.26-16.59%, achieving competitive performance relative to proprietary LLM-based agents (gpt-4o) in workplace-oriented web navigation tasks.

📄 PDF Abstract BibTeX arXiv:2505.22942

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SFT Shrink and Fine-Tune, or SFT, is a type of distillation that avoids explicit distillation by copying parameters to a student student model and then fine-tuning.…

DeepSeek-R1: Incentivizing Reasoning Capability in LLMs via Reinforcement Learning

2025-01-22 · DeepSeek-AI, Daya Guo, Dejian Yang, Haowei Zhang 외

We introduce our first-generation reasoning models, DeepSeek-R1-Zero and DeepSeek-R1. DeepSeek-R1-Zero, a model trained via large-scale reinforcement learning (RL) without supervised fine-tuning (SFT) as a preliminary st…

Mathematical Reasoning Multi-task Language Understanding Question Answering Reinforcement Learning (RL)

Reinforcement Pre-Training

2025-06-09 · Qingxiu Dong, Li Dong, Yao Tang, Tianzhu Ye 외

In this work, we introduce Reinforcement Pre-Training (RPT) as a new scaling paradigm for large language models and reinforcement learning (RL). Specifically, we reframe next-token prediction as a reasoning task trained …

Language Modeling Language Modelling Reinforcement Learning (RL)

D-CORE: Incentivizing Task Decomposition in Large Reasoning Models for Complex Tool Use

2026-02-02 · Bowen Xu, Shaoyu Wu, Hao Jiang, Kai Liu 외 arxiv

Effective tool use and reasoning are essential capabilities for large reasoning models~(LRMs) to address complex real-world problems. Through empirical analysis, we identify that current LRMs lack the capability of sub-t…

Reinforcement Learning

Incentivizing Reasoning from Weak Supervision

2025-05-26 · Yige Yuan, Teng Xiao, Shuchang Tao, Xue Wang 외

Large language models (LLMs) have demonstrated impressive performance on reasoning-intensive tasks, but enhancing their reasoning abilities typically relies on either reinforcement learning (RL) with verifiable signals o…

reinforcement-learning Reinforcement Learning Reinforcement Learning (RL)

Context Reasoner: Incentivizing Reasoning Capability for Contextualized Privacy and Safety Compliance via Reinforcement Learning

2025-05-20 · Wenbin Hu, Haoran Li, Huihao Jing, Qi Hu 외

While Large Language Models (LLMs) exhibit remarkable capabilities, they also introduce significant safety and privacy risks. Current mitigation strategies often fail to preserve contextual reasoning capabilities in risk…

MMLU Reinforcement Learning (RL)