paper-with-me

Papers

CurateEvo: Data-Curation Evolving for Agentic Post-Training

2026-07-07 · Dingzirui Wang, Xuanliang Zhang, Keyan Xu, Qingfu Zhu, Wanxiang Che arxiv

Large language model (LLM) agents require post-training methods that can improve long-horizon decision making from environment feedback. However, existing agentic post-training pipelines often treat data curation as a fixed preprocessing step, focusing mainly on data augmentation while neglecting filtering, refinement, and adaptation to downstream failures. We propose CurateEvo, a failure-driven dynamic evolution framework for agentic post-training data curation. CurateEvo represents the curation strategy as executable code and iteratively rewrites it using failed trajectories from a held-out development set. At each epoch, the evolved strategy transforms a fixed raw corpus into supervised fine-tuning data, reinforcement learning data, and an inference-time memory bank. The evolution process first improves effectiveness by diagnosing recurring failure modes and augmenting, filtering, or refining data accordingly, and then improves efficiency by pruning redundant or low-utility training turns under a cost-aware objective. Experiments on ACEBench-Agent, BFCL-V4, and τ^2-Bench under both labeled and wild-data settings show that CurateEvo consistently outperforms prior curation methods, improving average scores by 3.2 and 2.7 points, respectively. Further analyses demonstrate that CurateEvo is compatible with different post-training recipes and substantially reduces curation overhead.

📄 PDF Abstract BibTeX arXiv:2607.06140

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement LearningData AugmentationDecision Making

Similar Papers 제목 키워드 기반

SkillOS: Learning Skill Curation for Self-Evolving Agents

2026-05-07 · Siru Ouyang, Jun Yan, Yanfei Chen, Rujun Han 외 arxiv

LLM-based agents are increasingly deployed to handle streaming tasks, yet they often remain one-off problem solvers that fail to learn from past interactions. Reusable skills distilled from experience provide a natural s…

Agentic Context Engineering: Evolving Contexts for Self-Improving Language Models

2025-10-06 · Qizheng Zhang, Changran Hu, Shubhangi Upasani, Boyuan Ma 외 arxiv

Large language model (LLM) applications such as agents and domain-specific reasoning increasingly rely on context adaptation: modifying inputs with instructions, strategies, or evidence, rather than weight updates. Prior…

UpBench: A Dynamically Evolving Real-World Labor-Market Agentic Benchmark Framework Built for Human-Centric AI

2025-11-15 · Darvin Yi, Teng Liu, Mattie Terzolo, Lance Hasson 외 arxiv

As large language model (LLM) agents increasingly undertake digital work, reliable frameworks are needed to evaluate their real-world competence, adaptability, and capacity for human collaboration. Existing benchmarks re…

Organizational Memory for Agentic Business Process Execution

2026-07-03 · Lukas Kirchdorfer, Adrian Rebmann, Christian Warmuth, Timotheus Kampik 외 arxiv

LLM-based agents offer new opportunities for automating business process execution beyond the limits of rule-based systems. However, general-purpose LLMs lack the organization-specific knowledge required for reliable exe…

Exploring Autonomous Agentic Data Engineering for Model Specialization

2026-05-28 · Yujie Luo, Xiangyuan Ru, Jingsheng Zheng, Jingjing Wang 외 arxiv

Large Language Models (LLMs) have demonstrated strong performance on general tasks, while often struggling to adapt to specialized domains without high-quality domain-specific data. Existing LLM-based data curation metho…