paper-with-me

홈 › Papers

Laplacian-LoRA: Delaying Oversmoothing in Deep GCNs via Spectral Low-Rank Adaptation

2026-02-07 · Sai Vamsi Alisetti arxiv

Oversmoothing is a fundamental limitation of deep graph convolutional networks (GCNs), causing node representations to collapse as depth increases. While many prior approaches mitigate this effect through architectural modifications or residual mechanisms, the underlying spectral cause of oversmoothing is often left implicit. We propose Laplacian-LoRA, a simple and interpretable low-rank spectral adaptation of standard GCNs. Rather than redesigning message passing, Laplacian-LoRA introduces a learnable, spectrally anchored correction to the fixed Laplacian propagation operator, selectively weakening contraction while preserving stability and the low-pass inductive bias. Across multiple benchmark datasets and depths, Laplacian-LoRA consistently delays the onset of oversmoothing, extending the effective depth of GCNs by up to a factor of two. Embedding variance diagnostics confirm that these gains arise from delayed representational collapse, while learned spectral analysis demonstrates that the correction is smooth, bounded, and well behaved. Our results show that oversmoothing is a depth-dependent spectral phenomenon that can be systematically delayed through modest, low-rank adaptation of the graph propagation operator.

📄 PDF Abstract BibTeX arXiv:2602.07278

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Demystifying Oversmoothing in Attention-Based Graph Neural Networks

2023-05-25 · NeurIPS 2023 11 · Xinyi Wu, Amir Ajorlou, Zihui Wu, Ali Jadbabaie

Oversmoothing in Graph Neural Networks (GNNs) refers to the phenomenon where increasing network depth leads to homogeneous node representations. While previous work has established that Graph Convolutional Networks (GCNs…

Graph Attention

Two Sides of the Same Coin: Heterophily and Oversmoothing in Graph Convolutional Neural Networks

2021-02-12 · Yujun Yan, Milad Hashemi, Kevin Swersky, Yaoqing Yang 외

In node classification tasks, graph convolutional neural networks (GCNs) have demonstrated competitive performance over traditional methods on diverse graph data. However, it is known that the performance of GCNs degrade…

Node ClassificationNode Classification on Non-Homophilic (Heterophilic) Graphs

Graph Neural Networks Do Not Always Oversmooth

2024-06-04 · Bastian Epping, Alexandre René, Moritz Helias, Michael T. Schaub

Graph neural networks (GNNs) have emerged as powerful tools for processing relational data in applications. However, GNNs suffer from the problem of oversmoothing, the property that the features of all nodes exponentiall…

Graph Learning in 4D: a Quaternion-valued Laplacian to Enhance Spectral GCNs

2023-12-28 · Stefano Fiorini, Stefano Coniglio, Michele Ciavotta, Enza Messina

We introduce QuaterGCN, a spectral Graph Convolutional Network (GCN) with quaternion-valued weights at whose core lies the Quaternionic Laplacian, a quaternion-valued Laplacian matrix by whose proposal we generalize two …

Graph Learning

Learning Chebyshev Basis in Graph Convolutional Networks for Skeleton-based Action Recognition

2021-04-12 · Hichem Sahbi

Spectral graph convolutional networks (GCNs) are particular deep models which aim at extending neural networks to arbitrary irregular domains. The principle of these networks consists in projecting graph signals using th…

Action RecognitionSkeleton Based Action Recognition