paper-with-me

Papers

Large Language Model for Verilog Generation with Code-Structure-Guided Reinforcement Learning

2024-07-21 · Ning Wang, Bingkun Yao, Jie zhou, Xi Wang, Zhe Jiang, Nan Guan

Recent advancements in large language models (LLMs) have sparked significant interest in the automatic generation of Register Transfer Level (RTL) designs, particularly using Verilog. Current research on this topic primarily focuses on pre-training and instruction tuning, but the effectiveness of these methods is constrained by the limited availability of training data, as public Verilog code is far less abundant than software code. In particular, these methods struggle to effectively capture Verilog parallel code structures, which fundamentally differ from the imperative, sequential control flow typical in most software programming languages. This paper introduces VeriSeek, an LLM enhanced by reinforcement learning using a limited amount of high-quality training data to achieve high Verilog code generation performance. Our reinforcement learning approach employs code structure information as feedback signals to refine the pre-trained model, enabling it to effectively learn important patterns from Verilog code with parallel structures. Experiments show that VeriSeek outperforms state-of-the-art methods across multiple benchmarks.

📄 PDF Abstract BibTeX arXiv:2407.18271

Code (1)

CatIIIIIIII/veriseek 공식 구현 pytorch

Tasks

Code GenerationLanguage ModelingLanguage ModellingLarge Language Modelreinforcement-learningReinforcement Learning

Methods 이 논문이 사용한 방법론

BASE 설명 없음
ALIGN In the ALIGN method, visual and language representations are jointly trained from noisy image alt-text data. The image and text encoders are learned via contrastive loss…

Similar Papers 제목 키워드 기반

VeriGRAG: Enhancing LLM-Based Verilog Code Generation with Structure-Aware Soft Prompts

2025-09-27 · Jiayu Zhao, Song Chen arxiv

Large language models (LLMs) have demonstrated strong capabilities in generating Verilog code from natural language descriptions. However, Verilog code inherently encodes structural information of hardware circuits. Effe…

Code Generation

QiMeng-CRUX: Narrowing the Gap Between Natural Language and Verilog via Core Refined Understanding eXpression for Circuit Design

2025-11-25 · Lei Huang, Rui Zhang, Jiaming Guo, Yang Zhang 외 arxiv

Large language models (LLMs) have shown promising capabilities in hardware description language (HDL) generation. However, existing approaches often rely on free-form natural language descriptions that are often ambiguou…

Code Generation

hdl2v: A Code Translation Dataset for Enhanced LLM Verilog Generation

2025-06-05 · Charles Hong, Brendan Roberts, Huijae An, Alex Um 외

Large language models (LLMs) are playing an increasingly large role in domains such as code generation, including hardware code generation, where Verilog is the key language. However, the amount of publicly available Ver…

Code GenerationCode TranslationData AugmentationKnowledge Distillation

VerilogEval: Evaluating Large Language Models for Verilog Code Generation

2023-09-14 · Mingjie Liu, Nathaniel Pinckney, Brucek Khailany, Haoxing Ren

The increasing popularity of large language models (LLMs) has paved the way for their application in diverse domains. This paper proposes a benchmarking framework tailored specifically for evaluating LLM performance in t…

BenchmarkingCode Generation

Revisiting VerilogEval: A Year of Improvements in Large-Language Models for Hardware Code Generation

2024-08-20 · Nathaniel Pinckney, Christopher Batten, Mingjie Liu, Haoxing Ren 외

The application of large-language models (LLMs) to digital hardware code generation is an emerging field, with most LLMs primarily trained on natural language and software code. Hardware code like Verilog constitutes a s…

Code CompletionCode GenerationIn-Context LearningPrompt Engineering