paper-with-me

Papers

DeepGate4: Efficient and Effective Representation Learning for Circuit Design at Scale

2025-02-02 · Ziyang Zheng, Shan Huang, Jianyuan Zhong, Zhengyuan Shi, Guohao Dai, Ningyi Xu, Qiang Xu

Circuit representation learning has become pivotal in electronic design automation, enabling critical tasks such as testability analysis, logic reasoning, power estimation, and SAT solving. However, existing models face significant challenges in scaling to large circuits due to limitations like over-squashing in graph neural networks and the quadratic complexity of transformer-based models. To address these issues, we introduce DeepGate4, a scalable and efficient graph transformer specifically designed for large-scale circuits. DeepGate4 incorporates several key innovations: (1) an update strategy tailored for circuit graphs, which reduce memory complexity to sub-linear and is adaptable to any graph transformer; (2) a GAT-based sparse transformer with global and local structural encodings for AIGs; and (3) an inference acceleration CUDA kernel that fully exploit the unique sparsity patterns of AIGs. Our extensive experiments on the ITC99 and EPFL benchmarks show that DeepGate4 significantly surpasses state-of-the-art methods, achieving 15.5% and 31.1% performance improvements over the next-best models. Furthermore, the Fused-DeepGate4 variant reduces runtime by 35.1% and memory usage by 46.8%, making it highly efficient for large-scale circuit analysis. These results demonstrate the potential of DeepGate4 to handle complex EDA tasks while offering superior scalability and efficiency. Code is available at https://github.com/zyzheng17/DeepGate4-ICLR-25.

📄 PDF Abstract BibTeX arXiv:2502.01681

Code (1)

zyzheng17/DeepGate4-ICLR-25 공식 구현 pytorch

Tasks

Representation Learning

Methods 이 논문이 사용한 방법론

Attention 설명 없음
Cosine Annealing Cosine Annealing is a type of learning rate schedule that has the effect of starting with a large learning rate that is relatively rapidly decreased to a minimum value before…
Label Smoothing Label Smoothing is a regularization technique that introduces noise for the labels. This accounts for the fact that datasets may have mistakes in them, so maximizing the…
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…
Position-Wise Feed-Forward Layer 설명 없음
Adam 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LapEigen 설명 없음

Similar Papers 제목 키워드 기반

DeepGate2: Functionality-Aware Circuit Representation Learning

2023-05-25 · Zhengyuan Shi, Hongyang Pan, Sadaf Khan, Min Li 외

Circuit representation learning aims to obtain neural representations of circuit elements and has emerged as a promising research direction that can be applied to various EDA and logic reasoning tasks. Existing solutions…

Graph Neural NetworkRepresentation Learning

DeepGate3: Towards Scalable Circuit Representation Learning

2024-07-15 · Zhengyuan Shi, Ziyang Zheng, Sadaf Khan, Jianyuan Zhong 외

Circuit representation learning has shown promising results in advancing the field of Electronic Design Automation (EDA). Existing models, such as DeepGate Family, primarily utilize Graph Neural Networks (GNNs) to encode…

Representation Learning

DeepGate: Learning Neural Representations of Logic Gates

2021-11-26 · Min Li, Sadaf Khan, Zhengyuan Shi, Naixing Wang 외

Applying deep learning (DL) techniques in the electronic design automation (EDA) field has become a trending topic. Most solutions apply well-developed DL models to solve specific EDA problems. While demonstrating promis…

Graph Neural NetworkRepresentation Learning

Wrong Code, Right Structure: Learning Netlist Representations from Imperfect LLM-Generated RTL

2026-03-10 · Siyang Cai, Cangyuan Li, Yinhe Han, Ying Wang arxiv

Learning effective netlist representations is fundamentally constrained by the scarcity of labeled datasets, as real designs are protected by Intellectual Property (IP) and costly to annotate. Existing work therefore foc…

Component ClassificationRepresentation LearningData AugmentationCode Generation

Program-to-Circuit: Exploiting GNNs for Program Representation and Circuit Translation

2021-09-13 · Nan Wu, Huake He, Yuan Xie, Pan Li 외

Circuit design is complicated and requires extensive domain-specific expertise. One major obstacle stuck on the way to hardware agile development is the considerably time-consuming process of accurate circuit quality eva…

Transfer LearningTranslation