paper-with-me

홈 › Papers

Variational Graph Contrastive Learning

2024-11-11 · Shifeng Xie, Jhony H. Giraldo

Graph representation learning (GRL) is a fundamental task in machine learning, aiming to encode high-dimensional graph-structured data into low-dimensional vectors. Self-supervised learning (SSL) methods are widely used in GRL because they can avoid expensive human annotation. In this work, we propose a novel Subgraph Gaussian Embedding Contrast (SGEC) method. Our approach introduces a subgraph Gaussian embedding module, which adaptively maps subgraphs to a structured Gaussian space, ensuring the preservation of graph characteristics while controlling the distribution of generated subgraphs. We employ optimal transport distances, including Wasserstein and Gromov-Wasserstein distances, to effectively measure the similarity between subgraphs, enhancing the robustness of the contrastive learning process. Extensive experiments across multiple benchmarks demonstrate that SGEC outperforms or presents competitive performance against state-of-the-art approaches. Our findings provide insights into the design of SSL methods for GRL, emphasizing the importance of the distribution of the generated contrastive pairs.

📄 PDF Abstract BibTeX arXiv:2411.07150

Code (1)

shifengxie/sgec 공식 구현 pytorch

Tasks

Contrastive LearningGraph Representation LearningRepresentation LearningSelf-Supervised Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Generative Contrastive Graph Learning for Recommendation

2023-07-11 · Yonghui Yang, Zhengwei Wu, Le Wu, Kun Zhang 외

By treating users' interactions as a user-item graph, graph learning models have been widely deployed in Collaborative Filtering(CF) based recommendation. Recently, researchers have introduced Graph Contrastive Learning(…

Collaborative FilteringContrastive LearningData AugmentationGraph Learning+1

RenyiCL: Contrastive Representation Learning with Skew Renyi Divergence

2022-08-12 · Kyungmin Lee, Jinwoo Shin

Contrastive representation learning seeks to acquire useful representations by estimating the shared information between multiple views of data. Here, the choice of data augmentation is sensitive to the quality of learne…

Contrastive LearningData AugmentationRepresentation Learning

Uncertainty in Graph Contrastive Learning with Bayesian Neural Networks

2023-11-30 · Alexander Möllers, Alexander Immer, Elvin Isufi, Vincent Fortuin

Graph contrastive learning has shown great promise when labeled data is scarce, but large unlabeled datasets are available. However, it often does not take uncertainty estimation into account. We show that a variational …

Contrastive LearningNode Classification

Variational Noise-Contrastive Estimation

2018-10-18 · Benjamin Rhodes, Michael Gutmann

Unnormalised latent variable models are a broad and flexible class of statistical models. However, learning their parameters from data is intractable, and few estimation techniques are currently available for such models…

parameter estimationVariational Inference

Graph Contrastive Learning with Implicit Augmentations

2022-11-07 · Huidong Liang, Xingjian Du, Bilei Zhu, Zejun Ma 외

Existing graph contrastive learning methods rely on augmentation techniques based on random perturbations (e.g., randomly adding or dropping edges and nodes). Nevertheless, altering certain edges or nodes can unexpectedl…

Contrastive LearningGraph ClassificationNode Classification