paper-with-me

홈 › Papers

CktEvo: Repository-Level RTL Code Benchmark for Design Evolution

2026-02-10 · Zhengyuan Shi, Jingxin Wang, Tairan Cheng, Changran Xu, Weikang Qian, Qiang Xu arxiv

Register-Transfer Level (RTL) coding is an iterative, repository-scale process in which Power, Performance, and Area (PPA) emerge from interactions across many files and the downstream toolchain. While large language models (LLMs) have recently been applied to hardware design, most efforts focus on generation or debugging from natural-language prompts, where ambiguity and hallucinations necessitate expert review. A separate line of work begins from formal inputs, yet typically optimizes high-level synthesis or isolated modules and remains decoupled from cross-file dependencies. In this work, we present CktEvo, a benchmark and reference framework for repo-level RTL evolution. Unlike prior benchmarks consisting of isolated snippets, our benchmark targets complete IP cores where PPA emerges from cross-file dependencies. Our benchmark packages several high-quality Verilog repositories from real-world designs. We formalize the task as: given an initial repository, produce edits that preserve functional behavior while improving PPA. We also provide a closed-loop framework that couples LLM-proposed edits with toolchain feedback to enable cross-file modifications and iterative repair at repository scale. Our experiments demonstrate that the reference framework realizes PPA improvements without any human interactions. CktEvo establishes a rigorous and executable foundation for studying LLM-assisted RTL optimization that matters for engineering practice: repository-level, function-preserving, and PPA-driven.

📄 PDF Abstract BibTeX arXiv:2603.08718

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

R2C2-Coder: Enhancing and Benchmarking Real-world Repository-level Code Completion Abilities of Code Large Language Models

2024-06-03 · Ken Deng, Jiaheng Liu, He Zhu, Congnan Liu 외

Code completion models have made significant progress in recent years. Recently, repository-level code completion has drawn more attention in modern software development, and several baseline methods and benchmarks have …

BenchmarkingCode CompletionRetrieval

MHRC-Bench: A Multilingual Hardware Repository-Level Code Completion benchmark

2026-01-07 · Qingyun Zou, Jiahao Cui, Nuo Chen, Bingsheng He 외 arxiv

Large language models (LLMs) have achieved strong performance on code completion tasks in general-purpose programming languages. However, existing repository-level code completion benchmarks focus almost exclusively on s…

Code Completion

DependEval: Benchmarking LLMs for Repository Dependency Understanding

2025-03-09 · Junjia Du, Yadi Liu, Hongcheng Guo, Jiawei Wang 외

While large language models (LLMs) have shown considerable promise in code generation, real-world software development demands advanced repository-level reasoning. This includes understanding dependencies, project struct…

BenchmarkingCode Generation

Agentic Hardware Design as Repository-Level Code Evolution

2026-06-26 · Cunxi Yu, Chenhui Deng, Nathaniel Pinckney, Brucek Khailany arxiv

We present HORIZON, a self-evolving agent framework that treats hardware design as repository-level code evolution. A Markdown harness is compiled into a project pack containing domain knowledge, an executable evaluator,…

RepoTransBench: A Real-World Benchmark for Repository-Level Code Translation

2024-12-23 · Yanli Wang, Yanlin Wang, Suiquan Wang, Daya Guo 외

Repository-level code translation refers to translating an entire code repository from one programming language to another while preserving the functionality of the source repository. Many benchmarks have been proposed t…

Code TranslationTranslation