paper-with-me

Papers

Deeper Insights into Graph Convolutional Networks for Semi-Supervised Learning

2018-01-22 · Qimai Li, Zhichao Han, Xiao-Ming Wu

Many interesting problems in machine learning are being revisited with new deep learning tools. For graph-based semisupervised learning, a recent important development is graph convolutional networks (GCNs), which nicely integrate local vertex features and graph topology in the convolutional layers. Although the GCN model compares favorably with other state-of-the-art methods, its mechanisms are not clear and it still requires a considerable amount of labeled data for validation and model selection. In this paper, we develop deeper insights into the GCN model and address its fundamental limits. First, we show that the graph convolution of the GCN model is actually a special form of Laplacian smoothing, which is the key reason why GCNs work, but it also brings potential concerns of over-smoothing with many convolutional layers. Second, to overcome the limits of the GCN model with shallow architectures, we propose both co-training and self-training approaches to train GCNs. Our approaches significantly improve GCNs in learning with very few labels, and exempt them from requiring additional labels for validation. Extensive experiments on benchmarks have verified our theory and proposals.

📄 PDF Abstract BibTeX arXiv:1801.07606

Code (1)

liqimai/gcn tf

Tasks

Model SelectionNode Classification

Methods 이 논문이 사용한 방법론

Graph Convolutional Networks 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Stability and Generalization of Graph Convolutional Neural Networks

2019-05-03 · Saurabh Verma, Zhi-Li Zhang

Inspired by convolutional neural networks on 1D and 2D data, graph convolutional neural networks (GCNNs) have been developed for various learning tasks on graph data, and have shown superior performance on real-world dat…

Generalization BoundsGraph Learning

Deeper Insights into Deep Graph Convolutional Networks: Stability and Generalization

2024-10-11 · Guangrui Yang, Ming Li, Han Feng, Xiaosheng Zhuang

Graph convolutional networks (GCNs) have emerged as powerful models for graph learning tasks, exhibiting promising performance in various domains. While their empirical success is evident, there is a growing need to unde…

Graph Learning

Revisiting Graph Convolutional Network on Semi-Supervised Node Classification from an Optimization Perspective

2020-09-24 · Hongwei Zhang, Tijin Yan, Zenjun Xie, Yuanqing Xia 외

Graph convolutional networks (GCNs) have achieved promising performance on various graph-based tasks. However they suffer from over-smoothing when stacking more layers. In this paper, we present a quantitative study on t…

General ClassificationNode Classification

Seeing Convolution Through the Eyes of Finite Transformation Semigroup Theory: An Abstract Algebraic Interpretation of Convolutional Neural Networks

2019-05-26 · Andrew Hryniowski, Alexander Wong

Researchers are actively trying to gain better insights into the representational properties of convolutional neural networks for guiding better network designs and for interpreting a network's computational nature. Gain…

Network Interpretation

Wasserstein Soft Label Propagation on Hypergraphs: Algorithm and Generalization Error Bounds

2018-09-06 · Tingran Gao, Shahab Asoodeh, Yi Huang, James Evans

Inspired by recent interests of developing machine learning and data mining algorithms on hypergraphs, we investigate in this paper the semi-supervised learning algorithm of propagating "soft labels" (e.g. probability di…

PAC learning