paper-with-me

Papers

Graph Partner Neural Networks for Semi-Supervised Learning on Graphs

2021-10-18 · Langzhang Liang, Cuiyun Gao, Shiyi Chen, Shishi Duan, Yu Pan, Junjin Zheng, Lei Wang, Zenglin Xu

Graph Convolutional Networks (GCNs) are powerful for processing graph-structured data and have achieved state-of-the-art performance in several tasks such as node classification, link prediction, and graph classification. However, it is inevitable for deep GCNs to suffer from an over-smoothing issue that the representations of nodes will tend to be indistinguishable after repeated graph convolution operations. To address this problem, we propose the Graph Partner Neural Network (GPNN) which incorporates a de-parameterized GCN and a parameter-sharing MLP. We provide empirical and theoretical evidence to demonstrate the effectiveness of the proposed MLP partner on tackling over-smoothing while benefiting from appropriate smoothness. To further tackle over-smoothing and regulate the learning process, we introduce a well-designed consistency contrastive loss and KL divergence loss. Besides, we present a graph enhancement technique to improve the overall quality of edges in graphs. While most GCNs can work with shallow architecture only, GPNN can obtain better results through increasing model depth. Experiments on various node classification tasks have demonstrated the state-of-the-art performance of GPNN. Meanwhile, extensive ablation studies are conducted to investigate the contributions of each component in tackling over-smoothing and improving performance.

📄 PDF Abstract BibTeX arXiv:2110.09182

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGraph ClassificationLink PredictionNode Classification

Methods 이 논문이 사용한 방법론

GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…

Similar Papers 제목 키워드 기반

Semi-supervised Learning on Graphs with Generative Adversarial Nets

2018-09-01 · Ming Ding, Jie Tang, Jie Zhang

We investigate how generative adversarial nets (GANs) can help semi-supervised learning on graphs. We first provide insights on working principles of adversarial learning over graphs and then present GraphSGAN, a novel a…

Graph Partition Neural Networks for Semi-Supervised Classification

2018-03-16 · ICLR 2018 1 · Renjie Liao, Marc Brockschmidt, Daniel Tarlow, Alexander L. Gaunt 외

We present graph partition neural networks (GPNN), an extension of graph neural networks (GNNs) able to handle extremely large graphs. GPNNs alternate between locally propagating information between nodes in small subgra…

ClassificationGeneral ClassificationNode Classification

A nonlinear diffusion method for semi-supervised learning on hypergraphs

2021-03-27 · Francesco Tudisco, Konstantin Prokopchik, Austin R. Benson

Hypergraphs are a common model for multiway relationships in data, and hypergraph semi-supervised learning is the problem of assigning labels to all nodes in a hypergraph, given labels on just a few nodes. Diffusions and…

Semi-supervised Domain Adaptation on Graphs with Contrastive Learning and Minimax Entropy

2023-09-14 · Jiaren Xiao, Quanyu Dai, Xiao Shen, Xiaochen Xie 외

Label scarcity in a graph is frequently encountered in real-world applications due to the high cost of data labeling. To this end, semi-supervised domain adaptation (SSDA) on graphs aims to leverage the knowledge of a la…

Contrastive LearningDomain AdaptationNode ClassificationSemi-supervised Domain Adaptation

Semi-supervised Learning on Large Graphs: is Poisson Learning a Game-Changer?

2022-02-28 · Canh Hao Nguyen

We explain Poisson learning on graph-based semi-supervised learning to see if it could avoid the problem of global information loss problem as Laplace-based learning methods on large graphs. From our analysis, Poisson le…