Infinitely Wide Graph Convolutional Networks: Semi-supervised Learning via Gaussian Processes
Graph convolutional neural networks~(GCNs) have recently demonstrated promising results on graph-based semi-supervised classification, but little work has been done to explore their theoretical properties. Recently, several deep neural networks, e.g., fully connected and convolutional neural networks, with infinite hidden units have been proved to be equivalent to Gaussian processes~(GPs). To exploit both the powerful representational capacity of GCNs and the great expressive power of GPs, we investigate similar properties of infinitely wide GCNs. More specifically, we propose a GP regression model via GCNs~(GPGC) for graph-based semi-supervised learning. In the process, we formulate the kernel matrix computation of GPGC in an iterative analytical form. Finally, we derive a conditional distribution for the labels of unobserved nodes based on the graph structure, labels for the observed nodes, and the feature matrix of all the nodes. We conduct extensive experiments to evaluate the semi-supervised classification performance of GPGC and demonstrate that it outperforms other state-of-the-art methods by a clear margin on all the datasets while being efficient.
Code (0)
등록된 구현이 없습니다.
Tasks
Gaussian ProcessesGeneral ClassificationSimilar Papers 제목 키워드 기반
Graph Neural Network-Inspired Kernels for Gaussian Processes in Semi-Supervised Learning
Gaussian processes (GPs) are an attractive class of machine learning models because of their simplicity and flexibility as building blocks of more complex Bayesian models. Meanwhile, graph neural networks (GNNs) emerged …
Gaussian ProcessesGraph Neural NetworkInductive BiasNew Insights into Graph Convolutional Networks using Neural Tangent Kernels
Graph Convolutional Networks (GCNs) have emerged as powerful tools for learning on network structured data. Although empirically successful, GCNs exhibit certain behaviour that has no rigorous explanation -- for instance…
Semi-Supervised Learning With Graph Learning-Convolutional Networks
Graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may not be optimal f…
graph constructionGraph LearningGraph Learning-Convolutional Networks
Recently, graph Convolutional Neural Networks (graph CNNs) have been widely used for graph data representation and semi-supervised learning tasks. However, existing graph CNNs generally use a fixed graph which may be not…
graph constructionGraph LearningGraph Laplacian Regularized Graph Convolutional Networks for Semi-supervised Learning
Recently, graph convolutional network (GCN) has been widely used for semi-supervised classification and deep feature representation on graph-structured data. However, existing GCN generally fails to consider the local in…
ClassificationDimensionality ReductionGeneral Classification