paper-with-me

Papers

LayerDAG: A Layerwise Autoregressive Diffusion Model for Directed Acyclic Graph Generation

2024-11-04 · Mufei Li, Viraj Shitole, Eli Chien, Changhai Man, Zhaodong Wang, Srinivas Sridharan, Ying Zhang, Tushar Krishna, Pan Li

Directed acyclic graphs (DAGs) serve as crucial data representations in domains such as hardware synthesis and compiler/program optimization for computing systems. DAG generative models facilitate the creation of synthetic DAGs, which can be used for benchmarking computing systems while preserving intellectual property. However, generating realistic DAGs is challenging due to their inherent directional and logical dependencies. This paper introduces LayerDAG, an autoregressive diffusion model, to address these challenges. LayerDAG decouples the strong node dependencies into manageable units that can be processed sequentially. By interpreting the partial order of nodes as a sequence of bipartite graphs, LayerDAG leverages autoregressive generation to model directional dependencies and employs diffusion models to capture logical dependencies within each bipartite graph. Comparative analyses demonstrate that LayerDAG outperforms existing DAG generative models in both expressiveness and generalization, particularly for generating large-scale DAGs with up to 400 nodes-a critical scenario for system benchmarking. Extensive experiments on both synthetic and real-world flow graphs from various computing platforms show that LayerDAG generates valid DAGs with superior statistical properties and benchmarking performance. The synthetic DAGs generated by LayerDAG enhance the training of ML-based surrogate models, resulting in improved accuracy in predicting performance metrics of real-world DAGs across diverse computing platforms.

📄 PDF Abstract BibTeX arXiv:2411.02322

Code (1)

graph-com/layerdag 공식 구현 pytorch

Tasks

BenchmarkingGraph Generation

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

SeaDAG: Semi-autoregressive Diffusion for Conditional Directed Acyclic Graph Generation

2024-10-21 · Xinyi Zhou, Xing Li, Yingzhao Lian, Yiwen Wang 외

We introduce SeaDAG, a semi-autoregressive diffusion model for conditional generation of Directed Acyclic Graphs (DAGs). Considering their inherent layer-wise structure, we simulate layer-wise autoregressive generation b…

DecoderDenoisingGraph Generation

Directed Acyclic Transformer for Non-Autoregressive Machine Translation

2022-05-16 · Fei Huang, Hao Zhou, Yang Liu, Hang Li 외

Non-autoregressive Transformers (NATs) significantly reduce the decoding latency by generating all tokens in parallel. However, such independent predictions prevent NATs from capturing the dependencies between the tokens…

Knowledge DistillationMachine TranslationTranslation

Control-DAG: Constrained Decoding for Non-Autoregressive Directed Acyclic T5 using Weighted Finite State Automata

2024-04-10 · Jinghong Chen, Weizhe Lin, Jingbiao Mei, Bill Byrne

The Directed Acyclic Transformer is a fast non-autoregressive (NAR) model that performs well in Neural Machine Translation. Two issues prevent its application to general Natural Language Generation (NLG) tasks: frequent …

Machine TranslationText GenerationTranslation

Viterbi Decoding of Directed Acyclic Transformer for Non-Autoregressive Machine Translation

2022-10-11 · Chenze Shao, Zhengrui Ma, Yang Feng

Non-autoregressive models achieve significant decoding speedup in neural machine translation but lack the ability to capture sequential dependency. Directed Acyclic Transformer (DA-Transformer) was recently proposed to m…

Machine TranslationTranslation

Directed Acyclic Transformer Pre-training for High-quality Non-autoregressive Text Generation

2023-04-24 · Fei Huang, Pei Ke, Minlie Huang

Non-AutoRegressive (NAR) text generation models have drawn much attention because of their significantly faster decoding speed and good generation quality in machine translation. However, in a wider range of text generat…

Machine TranslationText Generation