Bayesian Semi-supervised Learning with Graph Gaussian Processes
We propose a data-efficient Gaussian process-based Bayesian approach to the semi-supervised learning problem on graphs. The proposed model shows extremely competitive performance when compared to the state-of-the-art graph neural networks on semi-supervised learning benchmark experiments, and outperforms the neural networks in active learning experiments where labels are scarce. Furthermore, the model does not require a validation data set for early stopping to control over-fitting. Our model can be viewed as an instance of empirical distribution regression weighted locally by network connectivity. We further motivate the intuitive construction of the model with a Bayesian linear model interpretation where the node features are filtered by an operator related to the graph Laplacian. The method can be easily implemented by adapting off-the-shelf scalable variational inference algorithms for Gaussian processes.
Code (2)
Tasks
Active LearningGaussian ProcessesVariational InferenceSimilar Papers 제목 키워드 기반
Semi-parametric Expert Bayesian Network Learning with Gaussian Processes and Horseshoe Priors
This paper proposes a model learning Semi-parametric rela- tionships in an Expert Bayesian Network (SEBN) with linear parameter and structure constraints. We use Gaussian Pro- cesses and a Horseshoe prior to introduce mi…
Gaussian ProcessesGraph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning
Gaussian processes (GPs) are an attractive class of machine learning models because of their simplicity and flexibility as building blocks of more complex Bayesian models. Meanwhile, graph neural networks (GNNs) emerged …
Gaussian ProcessesGraph Neural NetworkInductive BiasInfinitely Wide Graph Convolutional Networks: Semi-supervised Learning via Gaussian Processes
Graph convolutional neural networks~(GCNs) have recently demonstrated promising results on graph-based semi-supervised classification, but little work has been done to explore their theoretical properties. Recently, seve…
Gaussian ProcessesGeneral ClassificationClassification using log Gaussian Cox processes
McCullagh and Yang (2006) suggest a family of classification algorithms based on Cox processes. We further investigate the log Gaussian variant which has a number of appealing properties. Conditioned on the covariates, t…
ClassificationGeneral ClassificationSemi-described and semi-supervised learning with Gaussian processes
Propagating input uncertainty through non-linear Gaussian process (GP) mappings is intractable. This hinders the task of training GPs using uncertain and partially observed inputs. In this paper we refer to this task as …
Gaussian ProcessesMissing Values