paper-with-me

Papers

SetupX: Can LLM Agents Learn from Past Failures in Functionality-Correct Code Repository Setup?

2026-05-25 · Zihang Zhou, Ziqian Ren, Yukai Wu, Yingjie Xiong, Wei Zhou, Chao Peng, Dong Zhang, Bingheng Yan, Xuanhe Zhou, Fan Wu arxiv

Functionality-correct repository setup aims to configure execution environments (e.g., dependencies, build scripts) to successfully execute a repository's documented features. It presents significant challenges due to diverse, repository-specific failures, including dependency incompatibilities, missing toolchains, incomplete installations, and verification-strategy mismatches. Existing LLM agents struggle to robustly resolve these issues, specifically failing to support (1) cross-repository experience transfer, (2) multi-step trial-and-repair under non-invertible state changes, and (3) robust verification of setup outcomes to distinguish setup-induced failures from repository bugs. To address this, we introduce SetupX, an experiential learning-based setup framework. First, we construct a Self-Evolving Experience Representation (XPU), a dual-modality knowledge unit encoding setup signals, textual guidance, executable actions to dynamically transfer verified environment fixes to unseen repositories. Second, we employ Experience-Augmented Speculative Execution backed by a LIFO Docker snapshot stack, enabling the agent to proactively trial fixes and safely roll back to known-good states. Third, we introduce a Prosecutor-Judge Verification Protocol that separates evidence collection from final judgment, enabling more reliable setup verification beyond superficial build-time metrics. Evaluation results on carefully-crafted benchmarks show SetupX achieves highest performance (e.g., 92% pass rate) and outperforms the strongest baseline by over 19%. Crucially, SetupX excels in complex multi-repository setup requiring coordinating multiple interconnected services across different containers. The code repository is available at https://github.com/OpenDataBox/SetupX.

📄 PDF Abstract BibTeX arXiv:2605.26186

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RAP: Retrieval-Augmented Planning with Contextual Memory for Multimodal LLM Agents

2024-02-06 · Tomoyuki Kagaya, Thong Jing Yuan, Yuxuan Lou, Jayashree Karlekar 외

Owing to recent advancements, Large Language Models (LLMs) can now be deployed as agents for increasingly complex decision-making applications in areas including robotics, gaming, and API integration. However, reflecting…

Decision MakingRetrieval

Naive Visual Memory is Not Enough: A Failure-Mode Study of GUI Agents

2026-06-12 · Seoyoung Choi, Minseok Ko, Hyunseok Lee, Kunwoong Kim 외 arxiv

Graphical User Interface (GUI) agents are increasingly used to automate complex computer tasks across applications, websites, and operating systems. To improve their reliability, recent work has introduced experiential m…

Towards Risk-free AI Agent Deployment

2026-08-17 · Yintong Huo, Rangeet Pan, Abhik Roychoudhury arxiv

LLM-based agents are rapidly moving from research prototypes into the core business processes of organizations, but these agents pose deployment risks to security, compliance, and functionality. In this article, we argue…

Improving Code Localization with Repository Memory

2025-10-01 · Boshi Wang, Weijian Xu, Yunsheng Li, Mei Gao 외 arxiv

Code localization is a fundamental challenge in repository-level software engineering tasks such as bug fixing. While existing methods equip language agents with comprehensive tools/interfaces to fetch information from t…

The Fallacy of AI Functionality

2022-06-20 · Inioluwa Deborah Raji, I. Elizabeth Kumar, Aaron Horowitz, Andrew D. Selbst

Deployed AI systems often do not work. They can be constructed haphazardly, deployed indiscriminately, and promoted deceptively. However, despite this reality, scholars, the press, and policymakers pay too little attenti…