paper-with-me

홈 › Papers

Layer-wise Adaptive Graph Convolution Networks Using Generalized Pagerank

2021-08-24 · Kishan Wimalawarne, Taiji Suzuki

We investigate adaptive layer-wise graph convolution in deep GCN models. We propose AdaGPR to learn generalized Pageranks at each layer of a GCNII network to induce adaptive convolution. We show that the generalization bound for AdaGPR is bounded by a polynomial of the eigenvalue spectrum of the normalized adjacency matrix in the order of the number of generalized Pagerank coefficients. By analysing the generalization bounds we show that oversmoothing depends on both the convolutions by the higher orders of the normalized adjacency matrix and the depth of the model. We performed evaluations on node-classification using benchmark real data and show that AdaGPR provides improved accuracies compared to existing graph convolution networks while demonstrating robustness against oversmoothing. Further, we demonstrate that analysis of coefficients of layer-wise generalized Pageranks allows us to qualitatively understand convolution at each layer enabling model interpretations.

📄 PDF Abstract BibTeX arXiv:2108.10636

Code (0)

등록된 구현이 없습니다.

Tasks

Generalization BoundsNode Classification

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음
GCNII GCNII is an extension of a Graph Convolution Networks with two new techniques, initial residual and identify mapping, to tackle…
AdaGPR AdaGPR is an adaptive, layer-wise graph convolution model. AdaGPR applies adaptive generalized Pageranks at each layer of a…
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
GCN A Graph Convolutional Network, or GCN, is an approach for semi-supervised learning on graph-structured data. It is based on an efficient variant of [convolutional neural…

Similar Papers 제목 키워드 기반

Adaptive Graph Diffusion Networks

2020-12-30 · Chuxiong Sun, Jie Hu, Hongming Gu, Jinpeng Chen 외

Graph Neural Networks (GNNs) have received much attention in the graph deep learning domain. However, recent research empirically and theoretically shows that deep GNNs suffer from over-fitting and over-smoothing problem…

GPULink PredictionNode ClassificationNode Property Prediction

Layer-wise Adaptive Step-Sizes for Stochastic First-Order Methods for Deep Learning

2023-05-23 · Achraf Bahamou, Donald Goldfarb

We propose a new per-layer adaptive step-size procedure for stochastic first-order optimization methods for minimizing empirical loss functions in deep learning, eliminating the need for the user to tune the learning rat…

Learning to Approximate Adaptive Kernel Convolution on Graphs

2024-01-22 · Jaeyoon Sim, Sooyeon Jeon, InJun Choi, Guorong Wu 외

Various Graph Neural Networks (GNNs) have been successful in analyzing data in non-Euclidean spaces, however, they have limitations such as oversmoothing, i.e., information becomes excessively averaged as the number of h…

Multi-Modal Graph Interaction for Multi-Graph Convolution Network in Urban Spatiotemporal Forecasting

2019-05-27 · Xu Geng, Xiyu Wu, Lingyu Zhang, Qiang Yang 외

Graph convolution network based approaches have been recently used to model region-wise relationships in region-level prediction problems in urban computing. Each relationship represents a kind of spatial dependency, lik…

BIG-bench Machine LearningDemand Forecasting

Retrieval-based Layer-wise Adaptive Transformer for Source Code Summarization

2021-11-16 · ACL ARR November 2021 11 · Anonymous

We propose a model that learns both the sequential and the structural features of code for source code summarization. We adopt the Abstract Syntax Tree (AST) and graph convolution to model the structural information and …

Code SummarizationRetrievalSource Code Summarization