paper-with-me

Papers

Personalized PageRank meets Graph Attention Networks

2021-09-29 · Julie Choi

There has been a rising interest in graph neural networks (GNNs) for representation learning over the past few years. GNNs provide a general and efficient framework to learn from graph-structured data. However, GNNs typically only use the information of a very limited neighborhood for each node. A larger neighborhood would be desirable to provide the model with more information. However, increasing the size of the neighborhood is not trivial since neighborhood aggregation over many layers leads to over-smoothing. In this work, we incorporate the limit distribution of Personalized PageRank (PPR) into graph attention networks (GATs) to address this issue. Intuitively, message aggregation based on Personalized PageRank corresponds to infinitely many neighborhood aggregation layers. We show that our models outperform a variety ofbaseline models across all datasets used for our experiments. Our implementation is publicly available online.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Graph AttentionRepresentation Learning

Similar Papers 제목 키워드 기반

Personalized PageRank Graph Attention Networks

2022-05-27 · Julie Choi

There has been a rising interest in graph neural networks (GNNs) for representation learning over the past few years. GNNs provide a general and efficient framework to learn from graph-structured data. However, GNNs typi…

Graph AttentionRepresentation Learning

Mean Field Analysis of Personalized PageRank with Implications for Local Graph Clustering

2018-06-20 · Avrachenkov Konstantin, Kadavankandy Arun, Litvak Nelly

We analyse a mean-field model of Personalized PageRank on the Erdos-Renyi random graph containing a denser planted Erdos-Renyi subgraph. We investigate the regimes where the values of Personalized PageRank concentrate ar…

ClusteringGraph Clustering

Multi-hop Attention-based Graph Pooling: A Personalized PageRank Perspective

2024-03-04 · International Conference on Distributed Computing and High Performance Computing (DCHPC) 2024 3 · Parsa Haddadian, Roya Booryaee, Rooholah Abedian, Ali Moeini

Over the past ten years, graph representation learning has garnered a lot of attention due to the variety of graph-structured data and its efficiency in both time and space. One essential method for obtaining effective g…

Graph ClassificationGraph Representation LearningRepresentation Learning

Network Capacity Bound for Personalized PageRank in Multimodal Networks

2017-06-01 · M. A. Kłopotek, S. T. Wierzchoń, R. A. Kłopotek

In a former paper the concept of Bipartite PageRank was introduced and a theorem on the limit of authority flowing between nodes for personalized PageRank has been generalized. In this paper we want to extend those resul…

Transforming PageRank into an Infinite-Depth Graph Neural Network

2022-07-01 · Andreas Roth, Thomas Liebig

Popular graph neural networks are shallow models, despite the success of very deep architectures in other application domains of deep learning. This reduces the modeling capacity and leaves models unable to capture long-…

Graph ClassificationGraph Neural Network