paper-with-me

Papers

SERA: Soft-Verified Efficient Repository Agents

2026-01-28 · Ethan Shen, Daniel Tormoen, Saurabh Shah, Ali Farhadi, Tim Dettmers arxiv

Open-weight coding agents should hold a fundamental advantage over closed-source systems because they can specialize to private codebases, encoding repository-specific information directly in their weights. Yet the cost and complexity of training has kept this advantage theoretical until now. We present Soft-Verified Efficient Repository Agents (SERA), an efficient method for training coding agents that enables the rapid and cheap creation of agents specialized to private codebases. Using Soft Verified Generation (SVG), we generate thousands of trajectories from any code repository, without requiring unit tests. Beyond repository specialization, we apply SVG to a larger corpus of codebases, generating 200,000+ synthetic trajectories. Using only supervised finetuning (SFT), SERA achieves leading results among fully open-source (open data, method, code) models while matching the performance of open-weight models like Devstral-Small-2. Creating SERA models is 26x cheaper than reinforcement learning and 57x cheaper than previous synthetic data methods to reach equivalent performance. We use our dataset to provide detailed analysis of scaling laws, ablations, and confounding factors for training coding agents. Overall, we believe our work will greatly accelerate research on open coding agents and showcase the advantage of open-source models that can adapt to private codebases. We release SERA as the first model in Ai2's Open Coding Agents series, along with all our code, data, and Claude Code integration to support the research community.

📄 PDF Abstract BibTeX arXiv:2601.20789

Code (0)

등록된 구현이 없습니다.

Tasks

Reinforcement Learning

Similar Papers 제목 키워드 기반

SWE-Bench Pro Verified: A Reliable Benchmark for Software Engineering Agents

2026-09-08 · Pujun Zheng, Zixin Shang, Shufan Jiang, Wenhui Tian 외 hf

SWE-Bench Pro has emerged as a standard benchmark for evaluating software engineering agents on challenging repository-level tasks. However, our analysis work show that its evaluation is undermined by two sources of unre…

Vero: Can AI Agents Build Formally Verified Software Repositories?

2026-08-13 · Zhe Ye, Hantao Lou, Yuechun Sun, Peiyang Song 외 arxiv

AI agents are increasingly used for programming, but do not provide any guarantee on the correctness of generated code. Verified code generation, in which an agent produces both an implementation and a machine-checked pr…

Code Generation

TDFlow: Agentic Workflows for Test Driven Development

2025-10-27 · Kevin Han, Siddharth Maddikayala, Tim Knappe, Om Patel 외 arxiv

We introduce TDFlow, a novel test-driven agentic workflow that frames repository-scale software engineering as a test-resolution task, specifically designed to solve human-written tests. Given a set of tests, TDFlow repe…

Program Repair

Improving Code Localization with Repository Memory

2025-10-01 · Boshi Wang, Weijian Xu, Yunsheng Li, Mei Gao 외 arxiv

Code localization is a fundamental challenge in repository-level software engineering tasks such as bug fixing. While existing methods equip language agents with comprehensive tools/interfaces to fetch information from t…

RepoMirage: Probing Repository Context Reasoning in Code Agents with Perturbations

2026-05-25 · Hanyu Li, Yichi Zhang, Speed Zhu, Hang Su 외 arxiv

Code agents are currently having skillful performance on repository-level software engineering benchmarks, but it remains unclear whether success on end-to-end tasks such as issue resolution truly reflects repository con…