paper-with-me

Papers

Graph Neural Networks Are More Than Filters: Revisiting and Benchmarking from A Spectral Perspective

2024-12-10 · Yushun Dong, Patrick Soga, Yinhan He, Song Wang, Jundong Li

Graph Neural Networks (GNNs) have achieved remarkable success in various graph-based learning tasks. While their performance is often attributed to the powerful neighborhood aggregation mechanism, recent studies suggest that other components such as non-linear layers may also significantly affecting how GNNs process the input graph data in the spectral domain. Such evidence challenges the prevalent opinion that neighborhood aggregation mechanisms dominate the behavioral characteristics of GNNs in the spectral domain. To demystify such a conflict, this paper introduces a comprehensive benchmark to measure and evaluate GNNs' capability in capturing and leveraging the information encoded in different frequency components of the input graph data. Specifically, we first conduct an exploratory study demonstrating that GNNs can flexibly yield outputs with diverse frequency components even when certain frequencies are absent or filtered out from the input graph data. We then formulate a novel research problem of measuring and benchmarking the performance of GNNs from a spectral perspective. To take an initial step towards a comprehensive benchmark, we design an evaluation protocol supported by comprehensive theoretical analysis. Finally, we introduce a comprehensive benchmark on real-world datasets, revealing insights that challenge prevalent opinions from a spectral perspective. We believe that our findings will open new avenues for future advancements in this area. Our implementations can be found at: https://github.com/yushundong/Spectral-benchmark.

📄 PDF Abstract BibTeX arXiv:2412.07188

Code (1)

yushundong/spectral-benchmark 공식 구현 pytorch

Tasks

Benchmarking

Similar Papers 제목 키워드 기반

Revisiting $Ψ$DONet: microlocally inspired filters for incomplete-data tomographic reconstructions

2025-01-30 · Tatiana A. Bubba, Luca Ratti, Andrea Sebastiani

In this paper, we revisit a supervised learning approach based on unrolling, known as $\Psi$DONet, by providing a deeper microlocal interpretation for its theoretical analysis, and extending its study to the case of spar…

Tomographic Reconstructions

Revisiting convolutional neural network on graphs with polynomial approximations of Laplace-Beltrami spectral filtering

2020-10-26 · Shih-Gu Huang, Moo K. Chung, Anqi Qiu, Alzheimer's Disease Neuroimaging Initiative

This paper revisits spectral graph convolutional neural networks (graph-CNNs) given in Defferrard (2016) and develops the Laplace-Beltrami CNN (LB-CNN) by replacing the graph Laplacian with the LB operator. We then defin…

ClassificationGeneral Classification

An Experimental Study of the Transferability of Spectral Graph Networks

2020-12-18 · Axel Nilsson, Xavier Bresson

Spectral graph convolutional networks are generalizations of standard convolutional networks for graph-structured data using the Laplacian operator. A common misconception is the instability of spectral filters, i.e. the…

BenchmarkingGeneral ClassificationGraph ClassificationGraph Regression+1

Revisiting Graph Neural Networks: All We Have is Low-Pass Filters

2019-05-23 · Hoang NT, Takanori Maehara

Graph neural networks have become one of the most important techniques to solve machine learning problems on graph-structured data. Recent work on vertex classification proposed deep and distributed learning models to ac…

AllGeneral ClassificationGraph Neural Network

Revisiting semi-supervised training objectives for differentiable particle filters

2024-05-02 · Jiaxi Li, John-Joseph Brady, Xiongjie Chen, Yunpeng Li

Differentiable particle filters combine the flexibility of neural networks with the probabilistic nature of sequential Monte Carlo methods. However, traditional approaches rely on the availability of labelled data, i.e.,…