paper-with-me

Papers

Simple yet Effective Gradient-Free Graph Convolutional Networks

2023-02-01 · Yulin Zhu, Xing Ai, Qimai Li, Xiao-Ming Wu, Kai Zhou

Linearized Graph Neural Networks (GNNs) have attracted great attention in recent years for graph representation learning. Compared with nonlinear Graph Neural Network (GNN) models, linearized GNNs are much more time-efficient and can achieve comparable performances on typical downstream tasks such as node classification. Although some linearized GNN variants are purposely crafted to mitigate ``over-smoothing", empirical studies demonstrate that they still somehow suffer from this issue. In this paper, we instead relate over-smoothing with the vanishing gradient phenomenon and craft a gradient-free training framework to achieve more efficient and effective linearized GNNs which can significantly overcome over-smoothing and enhance the generalization of the model. The experimental results demonstrate that our methods achieve better and more stable performances on node classification tasks with varying depths and cost much less training time.

📄 PDF Abstract BibTeX arXiv:2302.00371

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkGraph Representation LearningNode ClassificationRepresentation Learning

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

SkipNode: On Alleviating Performance Degradation for Deep Graph Convolutional Networks

2021-12-22 · Weigang Lu, Yibing Zhan, Binbin Lin, Ziyu Guan 외

Graph Convolutional Networks (GCNs) suffer from performance degradation when models go deeper. However, earlier works only attributed the performance degeneration to over-smoothing. In this paper, we conduct theoretical …

Link PredictionNode Classification

Convolutional Kernel Networks for Graph-Structured Data

2020-03-11 · ICML 2020 1 · Dexiong Chen, Laurent Jacob, Julien Mairal

We introduce a family of multilayer graph kernels and establish new links between graph convolutional neural networks and kernel methods. Our approach generalizes convolutional kernel networks to graph-structured data, b…

Graph Classification

Non-convolutional Graph Neural Networks

2024-07-31 · Yuanqing Wang, Kyunghyun Cho

Rethink convolution-based graph neural networks (GNN) -- they characteristically suffer from limited expressiveness, over-smoothing, and over-squashing, and require specialized sparse kernels for efficient computation. H…

Graph Learning

Simple Question Answering by Attentive Convolutional Neural Network

2016-06-10 · COLING 2016 12 · Wenpeng Yin, Mo Yu, Bing Xiang, Bo-Wen Zhou 외

This work focuses on answering single-relation factoid questions over Freebase. Each question can acquire the answer from a single fact of form (subject, predicate, object) in Freebase. This task, simple question answeri…

Entity LinkingFact SelectionQuestion Answering

PipeGCN: Efficient Full-Graph Training of Graph Convolutional Networks with Pipelined Feature Communication

2022-03-20 · ICLR 2022 4 · Cheng Wan, Youjie Li, Cameron R. Wolfe, Anastasios Kyrillidis 외

Graph Convolutional Networks (GCNs) is the state-of-the-art method for learning graph-structured data, and training large-scale GCNs requires distributed training across multiple accelerators such that each accelerator i…