paper-with-me

홈 › Papers

Going Deeper into Permutation-Sensitive Graph Neural Networks

2022-05-28 · Zhongyu Huang, Yingheng Wang, Chaozhuo Li, Huiguang He

The invariance to permutations of the adjacency matrix, i.e., graph isomorphism, is an overarching requirement for Graph Neural Networks (GNNs). Conventionally, this prerequisite can be satisfied by the invariant operations over node permutations when aggregating messages. However, such an invariant manner may ignore the relationships among neighboring nodes, thereby hindering the expressivity of GNNs. In this work, we devise an efficient permutation-sensitive aggregation mechanism via permutation groups, capturing pairwise correlations between neighboring nodes. We prove that our approach is strictly more powerful than the 2-dimensional Weisfeiler-Lehman (2-WL) graph isomorphism test and not less powerful than the 3-WL test. Moreover, we prove that our approach achieves the linear sampling complexity. Comprehensive experiments on multiple synthetic and real-world datasets demonstrate the superiority of our model.

📄 PDF Abstract BibTeX arXiv:2205.14368

Code (1)

zhongyu1998/pg-gnn 공식 구현 pytorch

Similar Papers 제목 키워드 기반

What Functions Can Graph Neural Networks Generate?

2022-02-17 · Mohammad Fereydounian, Hamed Hassani, Amin Karbasi

In this paper, we fully answer the above question through a key algebraic condition on graph functions, called \textit{permutation compatibility}, that relates permutations of weights and features of the graph to functio…

Probabilistic Blocking with An Application to the Syrian Conflict

2018-10-11 · Rebecca C. Steorts, Anshumali Shrivastava

Entity resolution seeks to merge databases as to remove duplicate entries where unique identifiers are typically unknown. We review modern blocking approaches for entity resolution, focusing on those based upon locality …

BlockingEntity ResolutionInformation RetrievalRetrieval

Going Beyond Linear Mode Connectivity: The Layerwise Linear Feature Connectivity

2023-09-21 · NeurIPS 2023 11

Recent work has revealed many intriguing empirical phenomena in neural network training, despite the poorly understood and highly complex loss landscapes and training dynamics. One of these phenomena, Linear Mode Connect…

Permutation Entropy as a Conceptual Model to Analyse Brain Activity in Sleep

2023-12-12 · Alexander Edthofer, Iris Feldhammer, Thomas Fenzl, Andreas Körner 외

Sleep stage classification is a widely discussed topic, due to its importance in the diagnosis of sleep disorders, e.g. insomnia. Analysis of the brain activity during sleep is necessary to gain further insight into the …

DeeperGCN: All You Need to Train Deeper GCNs

2020-06-13 · Guohao Li, Chenxin Xiong, Ali Thabet, Bernard Ghanem

Graph Convolutional Networks (GCNs) have been drawing significant attention with the power of representation learning on graphs. Unlike Convolutional Neural Networks (CNNs), which are able to take advantage of stacking v…

AllGraph LearningGraph Property PredictionNode Property Prediction+2