paper-with-me

Papers

Revisiting Self-Supervised Heterogeneous Graph Learning from Spectral Clustering Perspective

2024-12-01 · Yujie Mo, Zhihe Lu, Runpeng Yu, Xiaofeng Zhu, Xinchao Wang

Self-supervised heterogeneous graph learning (SHGL) has shown promising potential in diverse scenarios. However, while existing SHGL methods share a similar essential with clustering approaches, they encounter two significant limitations: (i) noise in graph structures is often introduced during the message-passing process to weaken node representations, and (ii) cluster-level information may be inadequately captured and leveraged, diminishing the performance in downstream tasks. In this paper, we address these limitations by theoretically revisiting SHGL from the spectral clustering perspective and introducing a novel framework enhanced by rank and dual consistency constraints. Specifically, our framework incorporates a rank-constrained spectral clustering method that refines the affinity matrix to exclude noise effectively. Additionally, we integrate node-level and cluster-level consistency constraints that concurrently capture invariant and clustering information to facilitate learning in downstream tasks. We theoretically demonstrate that the learned representations are divided into distinct partitions based on the number of classes and exhibit enhanced generalization ability across tasks. Experimental results affirm the superiority of our method, showcasing remarkable improvements in several downstream tasks compared to existing methods.

📄 PDF Abstract BibTeX arXiv:2412.00742

Code (1)

YujieMo/SCHOOL 공식 구현 pytorch

Tasks

ClusteringGraph Learning

Methods 이 논문이 사용한 방법론

Spectral Clustering Spectral clustering has attracted increasing attention due to the promising ability in dealing with nonlinearly separable datasets [15], [16]. In spectral clustering, the…

Similar Papers 제목 키워드 기반

Rank-based Geographical Regularization: Revisiting Contrastive Self-Supervised Learning for Multispectral Remote Sensing Imagery

2026-01-05 · Tom Burgert, Leonard Hackel, Paolo Rota, Begüm Demir arxiv

Self-supervised learning (SSL) has become a powerful paradigm for learning from large, unlabeled datasets, particularly in computer vision (CV). However, applying SSL to multispectral remote sensing (RS) images presents …

Self-Supervised Learning

Revisiting the Bethe-Hessian: Improved Community Detection in Sparse Heterogeneous Graphs

2019-01-25 · NeurIPS 2019 12 · Lorenzo Dall'Amico, Romain Couillet, Nicolas Tremblay

Spectral clustering is one of the most popular, yet still incompletely understood, methods for community detection on graphs. This article studies spectral clustering based on the Bethe-Hessian matrix $H_r = (r^2-1)I_n +…

ClusteringCommunity DetectionStochastic Block Model

Spectral-Spatial Self-Supervised Learning for Few-Shot Hyperspectral Image Classification

2025-05-18 · Wenchen Chen, Yanmei Zhang, Zhongwei Xiao, Jianping Chu 외

Few-shot classification of hyperspectral images (HSI) faces the challenge of scarce labeled samples. Self-Supervised learning (SSL) and Few-Shot Learning (FSL) offer promising avenues to address this issue. However, exis…

Classification Of Hyperspectral ImagesDiversityFew-Shot LearningHyperspectral Image Classification+3

Heterogeneous Graph Contrastive Learning with Spectral Augmentation

2024-06-30 · Jing Zhang, Xiaoqian Jiang, Yingjie Xie, Cangqi Zhou

Heterogeneous graphs can well describe the complex entity relationships in the real world. For example, online shopping networks contain multiple physical types of consumers and products, as well as multiple relationship…

Contrastive LearningData AugmentationGraph Representation LearningRepresentation Learning

Rethinking Spectral Augmentation for Contrast-based Graph Self-Supervised Learning

2024-05-30 · Xiangru Jian, Xinjian Zhao, Wei Pang, Chaolong Ying 외

The recent surge in contrast-based graph self-supervised learning has prominently featured an intensified exploration of spectral cues. Spectral augmentation, which involves modifying a graph's spectral properties such a…

Self-Supervised Learning