paper-with-me

홈 › Papers

Sign and Basis Invariant Networks for Spectral Graph Representation Learning

2022-02-25 · Derek Lim, Joshua Robinson, Lingxiao Zhao, Tess Smidt, Suvrit Sra, Haggai Maron, Stefanie Jegelka

We introduce SignNet and BasisNet -- new neural architectures that are invariant to two key symmetries displayed by eigenvectors: (i) sign flips, since if $v$ is an eigenvector then so is $-v$; and (ii) more general basis symmetries, which occur in higher dimensional eigenspaces with infinitely many choices of basis eigenvectors. We prove that under certain conditions our networks are universal, i.e., they can approximate any continuous function of eigenvectors with the desired invariances. When used with Laplacian eigenvectors, our networks are provably more expressive than existing spectral methods on graphs; for instance, they subsume all spectral graph convolutions, certain spectral graph invariants, and previously proposed graph positional encodings as special cases. Experiments show that our networks significantly outperform existing baselines on molecular graph regression, learning expressive graph representations, and learning neural fields on triangle meshes. Our code is available at https://github.com/cptq/SignNet-BasisNet .

📄 PDF Abstract BibTeX arXiv:2202.13013

Code (2)

cptq/SignNet-BasisNet 공식 구현 pytorch
tum-vision/intrinsic-neural-fields pytorch

Tasks

Graph RegressionGraph Representation LearningRepresentation Learning

Similar Papers 제목 키워드 기반

Laplacian Canonization: A Minimalist Approach to Sign and Basis Invariant Spectral Embedding

2023-10-28 · NeurIPS 2023 11 · Jiangyan Ma, Yifei Wang, Yisen Wang

Spectral embedding is a powerful graph embedding technique that has received a lot of attention recently due to its effectiveness on Graph Transformers. However, from a theoretical perspective, the universal expressive p…

Graph ClassificationGraph EmbeddingGraph Regression

Representing and Learning Functions Invariant Under Crystallographic Groups

2023-06-08 · Ryan P. Adams, Peter Orbanz

Crystallographic groups describe the symmetries of crystals and other repetitive structures encountered in nature and the sciences. These groups include the wallpaper and space groups. We derive linear and nonlinear repr…

Gaussian Processes

Eigenbasis-Independent Learnable Spectral Positional Encodings for Directed Graphs via Hermitian Block Krylov Subspaces

2026-07-08 · Jiaqing Xie, Yuxin Wang arxiv

Spectral positional encodings (PEs) for \emph{directed} graphs face two obstacles: magnetic Laplacians require an $O(n^3)$ Hermitian eigendecomposition per potential, and their complex eigenvectors are defined only up to…

Don't Fix the Basis -- Learn It: Spectral Representation with Adaptive Basis Learning for PDEs

2026-05-11 · Xuxiang Zhao, Angelica I. Aviles-Rivero arxiv

Spectral neural operators achieve strong performance for PDE learning, but rely on fixed global bases that limit their ability to represent spatially heterogeneous and multiscale dynamics. We propose Adaptive Basis Learn…

DSBD: Dual-Aligned Structural Basis Distillation for Graph Domain Adaptation

2026-04-03 · Yingxu Wang, Kunyu Zhang, Jiaxin Huang, Mengzhu Wang 외 arxiv

Graph domain adaptation (GDA) aims to transfer knowledge from a labeled source graph to an unlabeled target graph under distribution shifts. However, existing methods are largely feature-centric and overlook structural d…

GRAPH DOMAIN ADAPTATION