paper-with-me

Papers

Towards Repository-Level Program Verification with Large Language Models

2025-08-31 · Si Cheng Zhong, Xujie Si arxiv

Recent advancements in large language models (LLMs) suggest great promises in code and proof generations. However, scaling automated formal verification to real-world projects requires resolving cross-module dependencies and global contexts, which are crucial challenges overlooked by existing LLM-based methods with a special focus on targeting isolated, function-level verification tasks. To systematically explore and address the significant challenges of verifying entire software repositories, we introduce RVBench, the first verification benchmark explicitly designed for repository-level evaluation, constructed from four diverse and complex open-source Verus projects. We further introduce RagVerus, an extensible framework that synergizes retrieval-augmented generation with context-aware prompting to automate proof synthesis for multi-module repositories. RagVerus triples proof pass rates on existing benchmarks under constrained model inference budgets, and achieves a 27% relative improvement on the more challenging RVBench benchmark, demonstrating a scalable and sample-efficient verification solution.

📄 PDF Abstract BibTeX arXiv:2509.25197

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

RAG-Verus: Repository-Level Program Verification with LLMs using Retrieval Augmented Generation

2025-02-07 · Sicheng Zhong, Jiading Zhu, Yifang Tian, Xujie Si

Scaling automated formal verification to real-world projects requires resolving cross-module dependencies and global contexts, which are challenges overlooked by existing function-centric methods. We introduce RagVerus, …

Language ModelingLanguage ModellingRAGRetrieval+1

RepoDebug: Repository-Level Multi-Task and Multi-Language Debugging Evaluation of Large Language Models

2025-09-04 · Jingjing Liu, Zeming Liu, Zihao Cheng, Mengliang He 외 arxiv

Large Language Models (LLMs) have exhibited significant proficiency in code debugging, especially in automatic program repair, which may substantially reduce the time consumption of developers and enhance their efficienc…

Program RepairCode Repair

SURGE: On the Potential of Large Language Models as General-Purpose Surrogate Code Executors

2025-02-16 · Bohan Lyu, Siqiao Huang, Zichen Liang

Large language models (LLMs) have demonstrated remarkable capabilities in code-related tasks, such as code understanding and code generation. However, an equally important yet underexplored question is whether LLMs can s…

Code Generation

From Laboratory to Real-World Applications: Benchmarking Agentic Code Reasoning at the Repository Level

2026-01-07 · Jia Li, Yuxin Su, Michael R. Lyu arxiv

As large language models (LLMs) evolve into autonomous agents, evaluating repository-level reasoning, the ability to maintain logical consistency across massive, real-world, interdependent file systems, has become critic…

RepoProbe: Benchmarking Architecture-Aware Repository Comprehension with Checklists

2026-08-05 · Yuexi Yang, Alyssa Wu, Ji Luo, Richeng Xuan 외 arxiv

The integration of Large Language Models (LLMs) into software engineering has shifted the focus from function-level generation to repository-scale assistance. However, existing benchmarks largely rely on bug reports from…

Code Generation