paper-with-me

홈 › Papers

Scale Invariance of Graph Neural Networks

2024-11-28 · Qin Jiang, Chengjia Wang, Michael Lones, Wei Pang

We address two fundamental challenges in Graph Neural Networks (GNNs): (1) the lack of theoretical support for invariance learning, a critical property in image processing, and (2) the absence of a unified model capable of excelling on both homophilic and heterophilic graph datasets. To tackle these issues, we establish and prove scale invariance in graphs, extending this key property to graph learning, and validate it through experiments on real-world datasets. Leveraging directed multi-scaled graphs and an adaptive self-loop strategy, we propose ScaleNet, a unified network architecture that achieves state-of-the-art performance across four homophilic and two heterophilic benchmark datasets. Furthermore, we show that through graph transformation based on scale invariance, uniform weights can replace computationally expensive edge weights in digraph inception networks while maintaining or improving performance. For another popular GNN approach to digraphs, we demonstrate the equivalence between Hermitian Laplacian methods and GraphSAGE with incidence normalization. ScaleNet bridges the gap between homophilic and heterophilic graph learning, offering both theoretical insights into scale invariance and practical advancements in unified graph learning. Our implementation is publicly available at https://github.com/Qin87/ScaleNet/tree/Aug23.

📄 PDF Abstract BibTeX arXiv:2411.19392

Code (1)

qin87/scalenet 공식 구현 pytorch

Tasks

Graph LearningNode ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs

Methods 이 논문이 사용한 방법론

ReLU How Do I Communicate to Expedia? How Do I Communicate to Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Live Support & Special Travel…
1x1 Convolution A 1 x 1 Convolution is a convolution with some special properties in that it can be used for dimensionality reduction,…
Average Pooling 설명 없음
Batch Normalization 설명 없음
Residual Connection 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Global Average Pooling Global Average Pooling is a pooling operation designed to replace fully connected layers in classical CNNs. The idea is to generate one feature map for each corresponding…

Similar Papers 제목 키워드 기반

ScaleNet: Scale Invariance Learning in Directed Graphs

2024-11-13 · Qin Jiang, Chengjia Wang, Michael Lones, Yingfang Yuan 외

Graph Neural Networks (GNNs) have advanced relational data analysis but lack invariance learning techniques common in image classification. In node classification with GNNs, it is actually the ego-graph of the center nod…

ClassificationGraph Learningimage-classificationImage Classification+1

Riesz networks: scale invariant neural networks in a single forward pass

2023-05-08 · Tin Barisin, Katja Schladitz, Claudia Redenbach

Scale invariance of an algorithm refers to its ability to treat objects equally independently of their size. For neural networks, scale invariance is typically achieved by data augmentation. However, when presented with …

Data Augmentation

Learning to Adapt Invariance in Memory for Person Re-identification

2019-08-01 · Zhun Zhong, Liang Zheng, Zhiming Luo, Shaozi Li 외

This work considers the problem of unsupervised domain adaptation in person re-identification (re-ID), which aims to transfer knowledge from the source domain to the target domain. Existing methods are primary to reduce …

Domain AdaptationPerson Re-IdentificationUnsupervised Domain Adaptation

Model Metamers Reveal Invariances in Graph Neural Networks

2025-10-20 · Wei Xu, Xiaoyi Jiang, Lixiang Xu, Dechao Tang arxiv

In recent years, deep neural networks have been extensively employed in perceptual systems to learn representations endowed with invariances, aiming to emulate the invariance mechanisms observed in the human brain. Howev…

Learning Online Visual Invariances for Novel Objects via Supervised and Self-Supervised Training

2021-10-04 · Valerio Biscione, Jeffrey S. Bowers

Humans can identify objects following various spatial transformations such as scale and viewpoint. This extends to novel objects, after a single presentation at a single pose, sometimes referred to as online invariance. …

Data AugmentationTranslation