paper-with-me

Papers

The Infinite Contextual Graph Markov Model

2021-09-29 · Daniele Castellana, Federico Errica, Davide Bacciu, Alessio Micheli

The Contextual Graph Markov Model is a deep, unsupervised, and probabilistic model for graphs that is trained incrementally on a layer-by-layer basis. As with most Deep Graph Networks, an inherent limitation is the lack of an automatic mechanism to choose the size of each layer's latent representation. In this paper, we circumvent the problem by extending the Contextual Graph Markov Model with Hierarchical Dirichlet Processes. The resulting model for graphs can automatically adjust the complexity of each layer without the need to perform an extensive model selection. To improve the scalability of the method, we introduce a novel approximated inference procedure that better deals with larger graph topologies. The quality of the learned unsupervised representations is then evaluated across a set of eight graph classification tasks, showing competitive performances against end-to-end supervised methods. The analysis is complemented by studies on the importance of depth, hyper-parameters, and compression of the graph embeddings. We believe this to be an important step towards the theoretically grounded and automatic construction of deep probabilistic architectures for graphs.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Graph ClassificationmodelModel Selection

Similar Papers 제목 키워드 기반

Structure Matters: Dynamic Policy Gradient

2024-11-07 · Sara Klein, Xiangyuan Zhang, Tamer Başar, Simon Weissmann 외

In this work, we study $\gamma$-discounted infinite-horizon tabular Markov decision processes (MDPs) and introduce a framework called dynamic policy gradient (DynPG). The framework directly integrates dynamic programming…

Multi-Armed Bandits

A reversible infinite HMM using normalised random measures

2014-03-17 · Konstantina Palla, David A. Knowles, Zoubin Ghahramani

We present a nonparametric prior over reversible Markov chains. We use completely random measures, specifically gamma processes, to construct a countably infinite graph with weighted edges. By enforcing symmetry to make …

Infinite Structured Hidden Semi-Markov Models

2014-06-30 · Jonathan H. Huggins, Frank Wood

This paper reviews recent advances in Bayesian nonparametric techniques for constructing and performing inference in infinite hidden Markov models. We focus on variants of Bayesian nonparametric hidden Markov models that…

Hypotheses testing on infinite random graphs

2017-08-10 · Daniil Ryabko

Drawing on some recent results that provide the formalism necessary to definite stationarity for infinite random graphs, this paper initiates the study of statistical and learning questions pertaining to these objects. S…

Time SeriesTime Series Analysis

The Infinite Factorial Hidden Markov Model

2008-12-01 · NeurIPS 2008 12 · Jurgen V. Gael, Yee W. Teh, Zoubin Ghahramani

We introduces a new probability distribution over a potentially infinite number of binary Markov chains which we call the Markov Indian buffet process. This process extends the IBP to allow temporal dependencies in the h…

blind source separationmodel