paper-with-me

홈 › Papers

Less is More: Hop-Wise Graph Attention for Scalable and Generalizable Learning on Circuits

2024-03-02 · Chenhui Deng, Zichao Yue, Cunxi Yu, Gokce Sarar, Ryan Carey, Rajeev Jain, Zhiru Zhang

While graph neural networks (GNNs) have gained popularity for learning circuit representations in various electronic design automation (EDA) tasks, they face challenges in scalability when applied to large graphs and exhibit limited generalizability to new designs. These limitations make them less practical for addressing large-scale, complex circuit problems. In this work we propose HOGA, a novel attention-based model for learning circuit representations in a scalable and generalizable manner. HOGA first computes hop-wise features per node prior to model training. Subsequently, the hop-wise features are solely used to produce node representations through a gated self-attention module, which adaptively learns important features among different hops without involving the graph topology. As a result, HOGA is adaptive to various structures across different circuits and can be efficiently trained in a distributed manner. To demonstrate the efficacy of HOGA, we consider two representative EDA tasks: quality of results (QoR) prediction and functional reasoning. Our experimental results indicate that (1) HOGA reduces estimation error over conventional GNNs by 46.76% for predicting QoR after logic synthesis; (2) HOGA improves 10.0% reasoning accuracy over GNNs for identifying functional blocks on unseen gate-level netlists after complex technology mapping; (3) The training time for HOGA almost linearly decreases with an increase in computing resources.

📄 PDF Abstract BibTeX arXiv:2403.01317

Code (1)

cornell-zhang/hoga 공식 구현 pytorch

Tasks

Graph Attention

Similar Papers 제목 키워드 기반

PolyFormer: Scalable Node-wise Filters via Polynomial Graph Transformer

2024-07-19 · Jiahong Ma, Mingguo He, Zhewei Wei

Spectral Graph Neural Networks have demonstrated superior performance in graph representation learning. However, many current methods focus on employing shared polynomial coefficients for all nodes, i.e., learning node-u…

Graph Representation LearningRepresentation Learning

Rethinking Node-wise Propagation for Large-scale Graph Learning

2024-02-09 · Xunkai Li, Jingyuan Ma, Zhengyu Wu, Daohan Su 외

Scalable graph neural networks (GNNs) have emerged as a promising technique, which exhibits superior predictive performance and high running efficiency across numerous large-scale graph-based web applications. However, (…

Graph LearningNode Classification

Deep Attentive Ranking Networks for Learning to Order Sentences

2019-12-31 · AAAI-2020 2019 12 · Pawan Kumar, Dhanajit Brahma, Harish Karnick, Piyush Rai

We present an attention-based ranking framework for learning to order sentences given a paragraph. Our framework is built on a bidirectional sentence encoder and a self-attention based transformer network to obtain an in…

SentenceSentence Ordering

A Scalable and Effective Alternative to Graph Transformers

2024-06-17 · Kaan Sancak, Zhigang Hua, Jin Fang, Yan Xie 외

Graph Neural Networks (GNNs) have shown impressive performance in graph representation learning, but they face challenges in capturing long-range dependencies due to their limited expressive power. To address this, Graph…

Graph LearningGraph Representation LearningRepresentation Learning

Scalable Graph Neural Networks via Bidirectional Propagation

2020-10-29 · NeurIPS 2020 12 · Ming Chen, Zhewei Wei, Bolin Ding, Yaliang Li 외

Graph Neural Networks (GNN) is an emerging field for learning on non-Euclidean data. Recently, there has been increased interest in designing GNN that scales to large graphs. Most existing methods use "graph sampling" or…

Graph Sampling