paper-with-me

Papers

Simple Spectral Graph Convolution

2021-01-01 · ICLR 2021 1 · Hao Zhu, Piotr Koniusz

Graph Convolutional Networks (GCNs) have drawn significant attention and become promising methods for learning graph representations. The most GCNs suffer the performance loss when the depth of the model increases. Similarly to CNNs, without specially designed architectures, the performance of a network degrades quickly. Some researchers argue that the required neighbourhood size and neural network depth are two completely orthogonal aspects of graph representation. Thus, several methods extend the neighbourhood by aggregating k-hop neighbourhoods of nodes while using shallow neural networks. However, these methods still encounter oversmoothing, high computation and storage costs. In this paper, we use the Markov diffusion kernel to derive a variant of GCN called Simple Spectral Graph Convolution (S^2GC) which is closely related to spectral models and combines strengths of both spatial and spectral methods. Our spectral analysis shows that our simple spectral graph convolution used in S^2GC is a low-pass filter which partitions networks into a few large parts. Our experimental evaluation demonstrates that S^2GC with a linear learner is competitive in text and node classification tasks. Moreover, S^2GC is comparable to other state-of-the-art methods for node clustering and community prediction tasks.

📄 PDF Abstract BibTeX

Code (2)

allenhaozhu/SSGC 공식 구현 pytorch
hazdzz/SSGC pytorch

Tasks

ClusteringNode ClassificationNode ClusteringText Classification

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

A Simple Spectral Failure Mode for Graph Convolutional Networks

2020-10-25 · Carey E. Priebe, Cencheng Shen, Ningyuan Huang, Tianyi Chen

Neural networks have achieved remarkable successes in machine learning tasks. This has recently been extended to graph learning using neural networks. However, there is limited theoretical work in understanding how and w…

Graph EmbeddingGraph Learning

Topology Adaptive Graph Convolutional Networks

2017-10-28 · ICLR 2018 1 · Jian Du, Shanghang Zhang, Guanhang Wu, Jose M. F. Moura 외

Spectral graph convolutional neural networks (CNNs) require approximation to the convolution to alleviate the computational complexity, resulting in performance loss. This paper proposes the topology adaptive graph convo…

Spectral Heterogeneous Graph Convolutions via Positive Noncommutative Polynomials

2023-05-31 · Mingguo He, Zhewei Wei, Shikun Feng, Zhengjie Huang 외

Heterogeneous Graph Neural Networks (HGNNs) have gained significant popularity in various heterogeneous graph learning tasks. However, most existing HGNNs rely on spatial domain-based methods to aggregate information, i.…

Graph LearningNode ClassificationNode Property Predictionvalid

Spectral GNN via Two-dimensional (2-D) Graph Convolution

2024-04-06 · Guoming Li, Jian Yang, Shangsong Liang, Dongsheng Luo

Spectral Graph Neural Networks (GNNs) have achieved tremendous success in graph learning. As an essential part of spectral GNNs, spectral graph convolution extracts crucial frequency information in graph data, leading to…

Graph Learning

A Graph Convolution for Signed Directed Graphs

2022-08-23 · Taewook Ko, Chong-Kwon Kim

A signed directed graph is a graph with sign and direction information on the edges. Even though signed directed graphs are more informative than unsigned or undirected graphs, they are more complicated to analyze and ha…

Link Sign Prediction