paper-with-me

Papers

Socratic-SWE: Self-Evolving Coding Agents via Trace-Derived Agent Skills

2026-06-05 · Chuan Xiao, Zhengbo Jiao, Shaobo Wang, Wei Wang, Bing Zhao, Hu Wei, Linfeng Zhang, Lin Qu arxiv

LLM-driven software engineering agents have become a central testbed for real-world language-model capability, yet their training remains limited by the availability of high-quality SWE tasks. Existing synthetic data methods typically create tasks through fixed mutation or bug-injection procedures, making the resulting distributions largely independent of the agent's own weaknesses and training progress. We introduce Socratic-SWE, a closed-loop self-evolution framework that reuses the agent's historical solving traces as a source of training signal. Rather than treating traces only as evidence for reward computation, Socratic-SWE distills them into structured agent skills that summarize recurring failures and effective repair patterns. These skills then guide the generation of targeted repair tasks in real repositories. Candidate tasks are checked through execution-based validation and scored with a solver-gradient alignment reward, so that the retained tasks are both verifiable and useful for improving the Solver. The updated Solver produces new traces, enabling the task curriculum to adapt over successive rounds. Across SWE-bench Verified, SWE-bench Lite, SWE-bench Pro, and Terminal-Bench 2.0, Socratic-SWE consistently improves over self-evolving baselines under the same compute budget, reaching 50.40% on SWE-bench Verified after three iterations. These results suggest that solving traces can serve as a scalable substrate for self-evolving SWE agents.

📄 PDF Abstract BibTeX arXiv:2606.07412

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Self-Evolving Coding Agents

2026-08-04 · Hao Zhou, Haichuan Hu, Ye Shang, Quanjun Zhang hf

Large language models are increasingly embedded in software engineering workflows as coding agents that can inspect repositories, invoke tools, execute tests, debug failures, and generate patches. Yet most existing agent…

Socratic-Zero : Bootstrapping Reasoning via Data-Free Agent Co-evolution

2025-09-29 · Shaobo Wang, Zhengbo Jiao, Zifan Zhang, Yilang Peng 외 arxiv

Recent breakthroughs in large language models (LLMs) on reasoning tasks rely heavily on massive, high-quality datasets-typically human-annotated and thus difficult to scale. While data synthesis or distillation offers a …

Mathematical Reasoning

BenchTrace: A Benchmark for Testing Reflection Ability and Controlled Evolution in LLM Agents

2026-05-28 · Jiahao Huang, Fei Cheng, Junfeng Jiang, Zefan Yu 외 arxiv

Self-evolving agents improve over time by reflecting on past failures, but existing evaluation is limited in two ways: it measures only task scores, leaving reflection quality unknown, and it relies on agents' own episod…

Socratic agents for autonomous scientific discovery in high-dimensional physical systems

2026-06-25 · Xianrui Zeng, Pengfei Liu, Yirui Zang, Yang Shen 외 arxiv

The automation of scientific discovery has reached an inflection point. While AI systems now operate instruments, optimize parameters and generate hypotheses, most remain procedural: they execute workflows fixed by human…

Group-Evolving Agents: Open-Ended Self-Improvement via Experience Sharing

2026-02-04 · Zhaotian Weng, Antonis Antoniades, Deepak Nathani, Zhen Zhang 외 arxiv

Open-ended self-improving agents can autonomously modify their own structural designs to advance their capabilities and overcome the limits of pre-defined architectures, thus reducing reliance on human intervention. We i…