paper-with-me

홈 › Papers

Equivariant Machine Learning on Graphs with Nonlinear Spectral Filters

2024-06-03 · Ya-Wei Eileen Lin, Ronen Talmon, Ron Levie

Equivariant machine learning is an approach for designing deep learning models that respect the symmetries of the problem, with the aim of reducing model complexity and improving generalization. In this paper, we focus on an extension of shift equivariance, which is the basis of convolution networks on images, to general graphs. Unlike images, graphs do not have a natural notion of domain translation. Therefore, we consider the graph functional shifts as the symmetry group: the unitary operators that commute with the graph shift operator. Notably, such symmetries operate in the signal space rather than directly in the spatial space. We remark that each linear filter layer of a standard spectral graph neural network (GNN) commutes with graph functional shifts, but the activation function breaks this symmetry. Instead, we propose nonlinear spectral filters (NLSFs) that are fully equivariant to graph functional shifts and show that they have universal approximation properties. The proposed NLSFs are based on a new form of spectral domain that is transferable between graphs. We demonstrate the superior performance of NLSFs over existing spectral GNNs in node and graph classification benchmarks.

📄 PDF Abstract BibTeX arXiv:2406.01249

Code (0)

등록된 구현이 없습니다.

Tasks

Graph ClassificationGraph Neural Network

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

On the Transferability of Spectral Graph Filters

2019-01-29 · Ron Levie, Elvin Isufi, Gitta Kutyniok

This paper focuses on spectral filters on graphs, namely filters defined as elementwise multiplication in the frequency domain of a graph. In many graph signal processing settings, it is important to transfer a filter fr…

Transferability of Spectral Graph Convolutional Neural Networks

2019-07-30 · Ron Levie, Wei Huang, Lorenzo Bucci, Michael M. Bronstein 외

This paper focuses on spectral graph convolutional neural networks (ConvNets), where filters are defined as elementwise multiplication in the frequency domain of a graph. In machine learning settings where the dataset co…

Expressive Sign Equivariant Networks for Spectral Geometric Learning

2023-12-04 · NeurIPS 2023 11 · Derek Lim, Joshua Robinson, Stefanie Jegelka, Haggai Maron

Recent work has shown the utility of developing machine learning models that respect the structure and symmetries of eigenvectors. These works promote sign invariance, since for any eigenvector v the negation -v is also …

Link PredictionNegation

Observer Design for Nonlinear Systems with Equivariance

2021-08-20 · Robert Mahony, Pieter van Goor, Tarek Hamel

Equivariance is a common and natural property of many nonlinear control systems, especially those associated with models of mechatronic and navigation systems. Such systems admit a symmetry, associated with the equivaria…

Specformer: Spectral Graph Neural Networks Meet Transformers

2023-03-02 · Deyu Bo, Chuan Shi, Lele Wang, Renjie Liao

Spectral graph neural networks (GNNs) learn graph representations via spectral-domain graph convolutions. However, most existing spectral graph filters are scalar-to-scalar functions, i.e., mapping a single eigenvalue to…

Decoder