Stochastic Training of Graph Convolutional Networks

2018-01-01 · ICLR 2018 1 · Jianfei Chen, Jun Zhu

Graph convolutional networks (GCNs) are powerful deep neural networks for graph-structured data. However, GCN computes nodes' representation recursively from their neighbors, making the receptive field size grow exponentially with the number of layers. Previous attempts on reducing the receptive field size by subsampling neighbors do not have any convergence guarantee, and their receptive field size per node is still in the order of hundreds. In this paper, we develop a preprocessing strategy and two control variate based algorithms to further reduce the receptive field size. Our algorithms are guaranteed to converge to GCN's local optimum regardless of the neighbor sampling size. Empirical results show that our algorithms have a similar convergence speed per epoch with the exact algorithm even using only two neighbors per node. The time consumption of our algorithm on the Reddit dataset is only one fifth of previous neighbor sampling algorithms.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Methods 이 논문이 사용한 방법론

SPEED The monocular depth estimation (MDE) is the task of estimating depth from a single frame. This information is an essential knowledge in many computer vision tasks such as scene…

GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

SSFG: Stochastically Scaling Features and Gradients for Regularizing Graph Convolutional Networks

2021-02-20 · Haimin Zhang, Min Xu, Guoqiang Zhang, Kenta Niwa

Graph convolutional networks have been successfully applied in various graph-based tasks. In a typical graph convolutional layer, node features are updated by aggregating neighborhood information. Repeatedly applying gra…

Graph Learning

LEARNING GUARANTEES FOR GRAPH CONVOLUTIONAL NETWORKS ON THE STOCHASTIC BLOCK MODEL

2021-09-29 · ICLR 2022 4 · Wei Lu

An abundance of neural network models and algorithms for diverse tasks on graphs have been developed in the past five years. However, very few provable guarantees have been available for the performance of graph neural n…

Community Detection Graph Neural Network Stochastic Block Model

Learning flexible representations of stochastic processes on graphs

2017-11-03 · Addison Bohannon, Brian Sadler, Radu Balan

Graph convolutional networks adapt the architecture of convolutional neural networks to learn rich representations of data supported on arbitrary graphs by replacing the convolution operations of convolutional neural net…

Transferring Dual Stochastic Graph Convolutional Network for Facial Micro-expression Recognition

2022-03-10 · Hui Tang, Li Chai, Wanli Lu

Micro-expression recognition has drawn increasing attention due to its wide application in lie detection, criminal detection and psychological consultation. To improve the recognition performance of the small micro-expre…

graph construction Micro Expression Recognition Micro-Expression Recognition Optical Flow Estimation+1

Neighbor-Sampling Based Momentum Stochastic Methods for Training Graph Neural Networks

2025-08-01 · Molly Noel, Gabriel Mancino-Ball, Yangyang Xu arxiv

Graph convolutional networks (GCNs) are a powerful tool for graph representation learning. Due to the recursive neighborhood aggregations employed by GCNs, efficient training methods suffer from a lack of theoretical gua…

Graph Representation Learning Node Classification