paper-with-me

홈 › Papers

Bayesian Deep Learning for Graphs

2022-02-24 · Federico Errica

The adaptive processing of structured data is a long-standing research topic in machine learning that investigates how to automatically learn a mapping from a structured input to outputs of various nature. Recently, there has been an increasing interest in the adaptive processing of graphs, which led to the development of different neural network-based methodologies. In this thesis, we take a different route and develop a Bayesian Deep Learning framework for graph learning. The dissertation begins with a review of the principles over which most of the methods in the field are built, followed by a study on graph classification reproducibility issues. We then proceed to bridge the basic ideas of deep learning for graphs with the Bayesian world, by building our deep architectures in an incremental fashion. This framework allows us to consider graphs with discrete and continuous edge features, producing unsupervised embeddings rich enough to reach the state of the art on several classification tasks. Our approach is also amenable to a Bayesian nonparametric extension that automatizes the choice of almost all model's hyper-parameters. Two real-world applications demonstrate the efficacy of deep learning for graphs. The first concerns the prediction of information-theoretic quantities for molecular simulations with supervised neural models. After that, we exploit our Bayesian models to solve a malware-classification task while being robust to intra-procedural code obfuscation techniques. We conclude the dissertation with an attempt to blend the best of the neural and Bayesian worlds together. The resulting hybrid model is able to predict multimodal distributions conditioned on input graphs, with the consequent ability to model stochasticity and uncertainty better than most works. Overall, we aim to provide a Bayesian perspective into the articulated research field of deep learning for graphs.

📄 PDF Abstract BibTeX arXiv:2202.12348

Code (0)

등록된 구현이 없습니다.

Tasks

Deep LearningGraph ClassificationGraph LearningMalware Classification

Similar Papers 제목 키워드 기반

On a hypergraph probabilistic graphical model

2018-11-20 · Mohammad Ali Javidian, Linyuan Lu, Marco Valtorta, Zhiyu Wang

We propose a directed acyclic hypergraph framework for a probabilistic graphical model that we call Bayesian hypergraphs. The space of directed acyclic hypergraphs is much larger than the space of chain graphs. Hence Bay…

model

Exact Inference Techniques for the Analysis of Bayesian Attack Graphs

2015-10-08 · Luis Muñoz-González, Daniele Sgandurra, Martín Barrère, Emil Lupu

Attack graphs are a powerful tool for security risk assessment by analysing network vulnerabilities and the paths attackers can use to compromise network resources. The uncertainty about the attacker's behaviour makes Ba…

Combinatorial and algebraic perspectives on the marginal independence structure of Bayesian networks

2022-10-03 · Danai Deligeorgaki, Alex Markham, Pratik Misra, Liam Solus

We consider the problem of estimating the marginal independence structure of a Bayesian network from observational data, learning an undirected graph we call the unconditional dependence graph. We show that unconditional…

Bayesian Optimisation of Functions on Graphs

2023-06-08 · NeurIPS 2023 11

The increasing availability of graph-structured data motivates the task of optimising over functions defined on the node set of graphs. Traditional graph search algorithms can be applied in this case, but they may be sam…

Bayesian Optimisation

Bayesian Network Score Approximation using a Metagraph Kernel

2008-12-01 · NeurIPS 2008 12 · Benjamin Yackley, Eduardo Corona, Terran Lane

Many interesting problems, including Bayesian network structure-search, can be cast in terms of finding the optimum value of a function over the space of graphs. However, this function is often expensive to compute exact…