paper-with-me

홈 › Papers

Learning Stable Graph Neural Networks via Spectral Regularization

2022-11-13 · Zhan Gao, Elvin Isufi

Stability of graph neural networks (GNNs) characterizes how GNNs react to graph perturbations and provides guarantees for architecture performance in noisy scenarios. This paper develops a self-regularized graph neural network (SR-GNN) solution that improves the architecture stability by regularizing the filter frequency responses in the graph spectral domain. The SR-GNN considers not only the graph signal as input but also the eigenvectors of the underlying graph, where the signal is processed to generate task-relevant features and the eigenvectors to characterize the frequency responses at each layer. We train the SR-GNN by minimizing the cost function and regularizing the maximal frequency response close to one. The former improves the architecture performance, while the latter tightens the perturbation stability and alleviates the information loss through multi-layer propagation. We further show the SR-GNN preserves the permutation equivariance, which allows to explore the internal symmetries of graph signals and to exhibit transference on similar graph structures. Numerical results with source localization and movie recommendation corroborate our findings and show the SR-GNN yields a comparable performance with the vanilla GNN on the unperturbed graph but improves substantially the stability.

📄 PDF Abstract BibTeX arXiv:2211.06966

Code (0)

등록된 구현이 없습니다.

Tasks

Graph Neural NetworkMovie Recommendation

Methods 이 논문이 사용한 방법론

Graph Neural Network 설명 없음

Similar Papers 제목 키워드 기반

A graph Laplacian regularization for hyperspectral data unmixing

2014-10-14 · Rita Ammanouil, André Ferrari, Cédric Richard

This paper introduces a graph Laplacian regularization in the hyperspectral unmixing formulation. The proposed regularization relies upon the construction of a graph representation of the hyperspectral image. Each node i…

Hyperspectral Unmixing

Structured Spectral Reasoning for Frequency-Adaptive Multimodal Recommendation

2025-12-01 · Wei Yang, Rui Zhong, Yiqun Chen, Chi Lu 외 arxiv

Multimodal recommendation aims to integrate collaborative signals with heterogeneous content such as visual and textual information, but remains challenged by modality-specific noise, semantic inconsistency, and unstable…

Multimodal Recommendation

Understanding Regularized Spectral Clustering via Graph Conductance

2018-06-05 · NeurIPS 2018 12 · Yilin Zhang, Karl Rohe

This paper uses the relationship between graph conductance and spectral clustering to study (i) the failures of spectral clustering and (ii) the benefits of regularization. The explanation is simple. Sparse and stochasti…

Clustering

Spectral Manifold Regularization for Stable and Modular Routing in Deep MoE Architectures

2026-01-07 · Ibrahim Delibasoglu arxiv

Mixture of Experts (MoE) architectures enable efficient scaling of neural networks but suffer from expert collapse, where routing converges to a few dominant experts. This reduces model capacity and causes catastrophic i…

Optimal Laplacian regularization for sparse spectral community detection

2019-12-03 · Lorenzo Dall'Amico, Romain Couillet, Nicolas Tremblay

Regularization of the classical Laplacian matrices was empirically shown to improve spectral clustering in sparse networks. It was observed that small regularizations are preferable, but this point was left as a heuristi…

ClusteringCommunity Detection