paper-with-me

홈 › Papers

How Do Practitioners Build SE Agents? Insights from a Mixed-Methods Study

2026-07-12 · Yunbo Lyu, David Williams, Jieke Shi, Zhensu Sun, Chao Peng, Zhou Yang, Federica Sarro, David Lo arxiv

The rise of Software Engineering (SE) agents, i.e., LLM-based agents that can understand large codebases and carry out engineering tasks with limited human intervention, has been marked by rapid advances and adoption, but little is known about how developers build these systems in practice: existing studies mine repositories or examine deployment, but few investigate how SE agents are constructed. Through semi-structured interviews with 20 practitioners from 12 organizations and an online survey of 80 practitioners, this paper is the first to study how SE processes are changing in the development of SE agents and what challenges developers face. We find that as implementation becomes cheaper, bottlenecks shift rather than disappear: long-standing work in requirements, coordination, and deployment becomes more visible, while reviewing generated code and evaluating agent behavior become new and increasingly central forms of work. We characterize a seven-stage workflow and five process shifts, including a move toward evaluation-driven development, in which evaluation is increasingly defined early and steers iteration, and the emergence of specifications as first-class artifacts that teams test and version alongside code. We further identify six challenges that teams face, together with 12 corresponding practices they use or propose to address them, including unreliable evaluation signals, comprehension debt as code outpaces understanding, and behavioral changes introduced by provider-side model updates.

📄 PDF Abstract BibTeX arXiv:2607.10856

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Measuring Agents in Production

2025-12-02 · Melissa Z. Pan, Negar Arabzadeh, Riccardo Cogo, Yuxuan Zhu 외 arxiv

LLM-based agents already operate in production across many industries, yet we lack an understanding of what technical methods make deployments successful. We present the first systematic study of Measuring Agents in Prod…

Statistical Jump Model for Mixed-Type Data with Missing Data Imputation

2024-09-02 · Federico P. Cortese, Antonio Pievatolo

In this paper, we address the challenge of clustering mixed-type data with temporal evolution by introducing the statistical jump model for mixed-type data. This novel framework incorporates regime persistence, enhancing…

ClusteringImputationManagement

MASA: LLM-Driven Multi-Agent Systems for Autoformalization

2025-10-10 · Lan Zhang, Marco Valentino, André Freitas arxiv

Autoformalization serves a crucial role in connecting natural language and formal reasoning. This paper presents MASA, a novel framework for building multi-agent systems for autoformalization driven by Large Language Mod…

AgentBuddy: A Contextual Bandit based Decision Support System for Customer Support Agents

2019-02-24 · Hrishikesh Ganu, Mithun Ghosh, Shashi Roshan

In this short paper, we present early insights from a Decision Support System for Customer Support Agents (CSAs) serving customers of a leading accounting software. The system is under development and is designed to prov…

On the Structural Memory of LLM Agents

2024-12-17 · Ruihong Zeng, Jinyuan Fang, Siwei Liu, Zaiqiao Meng

Memory plays a pivotal role in enabling large language model~(LLM)-based agents to engage in complex and long-term interactions, such as question answering (QA) and dialogue systems. While various memory modules have bee…

Language ModelingLanguage ModellingLarge Language ModelQuestion Answering+2