Homophily-Driven Sanitation View for Robust Graph Contrastive Learning
We investigate adversarial robustness of unsupervised Graph Contrastive Learning (GCL) against structural attacks. First, we provide a comprehensive empirical and theoretical analysis of existing attacks, revealing how and why they downgrade the performance of GCL. Inspired by our analytic results, we present a robust GCL framework that integrates a homophily-driven sanitation view, which can be learned jointly with contrastive learning. A key challenge this poses, however, is the non-differentiable nature of the sanitation objective. To address this challenge, we propose a series of techniques to enable gradient-based end-to-end robust GCL. Moreover, we develop a fully unsupervised hyperparameter tuning method which, unlike prior approaches, does not require knowledge of node labels. We conduct extensive experiments to evaluate the performance of our proposed model, GCHS (Graph Contrastive Learning with Homophily-driven Sanitation View), against two state of the art structural attacks on GCL. Our results demonstrate that GCHS consistently outperforms all state of the art baselines in terms of the quality of generated node embeddings as well as performance on two important downstream tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial RobustnessContrastive LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Homophily-aware Heterogeneous Graph Contrastive Learning
Heterogeneous graph pre-training (HGP) has demonstrated remarkable performance across various domains. However, the issue of heterophily in real-world heterogeneous graphs (HGs) has been largely overlooked. To bridge thi…
Contrastive LearningSimple and Asymmetric Graph Contrastive Learning without Augmentations
Graph Contrastive Learning (GCL) has shown superior performance in representation learning in graph-structured data. Despite their success, most existing GCL methods rely on prefabricated graph augmentation and homophily…
Contrastive LearningRepresentation LearningSelf-Supervised LearningRethinking Graph Contrastive Learning through Relative Similarity Preservation
Graph contrastive learning (GCL) has achieved remarkable success by following the computer vision paradigm of preserving absolute similarity between augmented views. However, this approach faces fundamental challenges in…
Contrastive LearningSeBot: Structural Entropy Guided Multi-View Contrastive Learning for Social Bot Detection
Recent advancements in social bot detection have been driven by the adoption of Graph Neural Networks. The social graph, constructed from social network interactions, contains benign and bot accounts that influence each …
Contrastive LearningMulti-Task LearningLOHA: Direct Graph Spectral Contrastive Learning Between Low-pass and High-pass Views
Spectral Graph Neural Networks effectively handle graphs with different homophily levels, with low-pass filter mining feature smoothness and high-pass filter capturing differences. When these distinct filters could natur…
Contrastive LearningDiversitySelf-Supervised Learning