D-VAE: A Variational Autoencoder for Directed Acyclic Graphs
Graph structured data are abundant in the real world. Among different graph types, directed acyclic graphs (DAGs) are of particular interest to machine learning researchers, as many machine learning models are realized as computations on DAGs, including neural networks and Bayesian networks. In this paper, we study deep generative models for DAGs, and propose a novel DAG variational autoencoder (D-VAE). To encode DAGs into the latent space, we leverage graph neural networks. We propose an asynchronous message passing scheme that allows encoding the computations on DAGs, rather than using existing simultaneous message passing schemes to encode local graph structures. We demonstrate the effectiveness of our proposed DVAE through two tasks: neural architecture search and Bayesian network structure learning. Experiments show that our model not only generates novel and valid DAGs, but also produces a smooth latent space that facilitates searching for DAGs with better performance through Bayesian optimization.
Code (2)
Tasks
Bayesian OptimizationBIG-bench Machine LearningNeural Architecture SearchvalidMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
ProDAG: Projected Variational Inference for Directed Acyclic Graphs
Directed acyclic graph (DAG) learning is a central task in structure discovery and causal inference. Although the field has witnessed remarkable advances over the past few years, it remains statistically and computationa…
Causal InferenceCombinatorial OptimizationUncertainty Quantificationvalid+1Scalable Variational Causal Discovery Unconstrained by Acyclicity
Bayesian causal discovery offers the power to quantify epistemic uncertainties among a broad range of structurally diverse causal theories potentially explaining the data, represented in forms of directed acyclic graphs …
Causal DiscoveryvalidVariational InferenceDAGSurv: Directed Acyclic Graph Based Survival Analysis Using Deep Neural Networks
Causal structures for observational survival data provide crucial information regarding the relationships between covariates and time-to-event. We derive motivation from the information theoretic source coding argument, …
Survival AnalysisSurvival PredictionVariational InferenceGravity-Inspired Graph Autoencoders for Directed Link Prediction
Graph autoencoders (AE) and variational autoencoders (VAE) recently emerged as powerful node embedding methods. In particular, graph AE and VAE were successfully leveraged to tackle the challenging link prediction proble…
DecoderLink PredictionPredictionLatent Optimal Paths by Gumbel Propagation for Variational Bayesian Dynamic Programming
We propose the stochastic optimal path which solves the classical optimal path problem by a probability-softening solution. This unified approach transforms a wide range of DP problems into directed acyclic graphs in whi…
Bayesian InferenceSinging Voice Synthesistext-to-speechText to Speech