paper-with-me

홈 › Papers

AS-GCL: Asymmetric Spectral Augmentation on Graph Contrastive Learning

2025-02-19 · Ruyue Liu, Rong Yin, Yong liu, Xiaoshuai Hao, Haichao Shi, Can Ma, Weiping Wang

Graph Contrastive Learning (GCL) has emerged as the foremost approach for self-supervised learning on graph-structured data. GCL reduces reliance on labeled data by learning robust representations from various augmented views. However, existing GCL methods typically depend on consistent stochastic augmentations, which overlook their impact on the intrinsic structure of the spectral domain, thereby limiting the model's ability to generalize effectively. To address these limitations, we propose a novel paradigm called AS-GCL that incorporates asymmetric spectral augmentation for graph contrastive learning. A typical GCL framework consists of three key components: graph data augmentation, view encoding, and contrastive loss. Our method introduces significant enhancements to each of these components. Specifically, for data augmentation, we apply spectral-based augmentation to minimize spectral variations, strengthen structural invariance, and reduce noise. With respect to encoding, we employ parameter-sharing encoders with distinct diffusion operators to generate diverse, noise-resistant graph views. For contrastive loss, we introduce an upper-bound loss function that promotes generalization by maintaining a balanced distribution of intra- and inter-class distance. To our knowledge, we are the first to encode augmentation views of the spectral domain using asymmetric encoders. Extensive experiments on eight benchmark datasets across various node-level tasks demonstrate the advantages of the proposed method.

📄 PDF Abstract BibTeX arXiv:2502.13525

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningData AugmentationSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…
Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Simple and Asymmetric Graph Contrastive Learning without Augmentations

2023-10-29 · NeurIPS 2023 11 · Teng Xiao, Huaisheng Zhu, Zhengyu Chen, Suhang Wang

Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily…

Contrastive LearningRepresentation LearningSelf-Supervised Learning

Spectral Feature Augmentation for Graph Contrastive Learning and Beyond

2022-12-02 · Yifei Zhang, Hao Zhu, Zixing Song, Piotr Koniusz 외

Although augmentations (e.g., perturbation of graph edges, image crops) boost the efficiency of Contrastive Learning (CL), feature level augmentation is another plausible, complementary yet not well researched strategy. …

Contrastive Learning

Disentangle-then-Refine: LLM-Guided Decoupling and Structure-Aware Refinement for Graph Contrastive Learning

2026-04-16 · Zhaoxing Li, Hai-Feng Zhang, Xiaoming Zhang arxiv

Conventional Graph Contrastive Learning (GCL) on Text-Attributed Graphs (TAGs) relies on blind stochastic augmentations, inadvertently entangling task-relevant signals with noise. We propose SDM-SCR, a robust framework a…

Contrastive Learning

Spectral Augmentations for Graph Contrastive Learning

2023-02-06 · Amur Ghose, Yingxue Zhang, Jianye Hao, Mark Coates

Contrastive learning has emerged as a premier method for learning representations with or without supervision. Recent studies have shown its utility in graph representation learning for pre-training. Despite successes, t…

Contrastive LearningGraph EmbeddingGraph Representation LearningRepresentation Learning

CGCL: Collaborative Graph Contrastive Learning without Handcrafted Graph Data Augmentations

2021-11-05 · Tianyu Zhang, Yuxiang Ren, Wenzheng Feng, Weitao Du 외

Unsupervised graph representation learning is a non-trivial topic. The success of contrastive methods in the unsupervised representation learning on structured data inspires similar attempts on the graph. Existing graph …

Contrastive LearningData AugmentationGraph Representation LearningRepresentation Learning+1