paper-with-me

홈 › Papers

Generating Counterfactual Hard Negative Samples for Graph Contrastive Learning

2022-07-01 · Haoran Yang, Hongxu Chen, Sixiao Zhang, Xiangguo Sun, Qian Li, Xiangyu Zhao, Guandong Xu

Graph contrastive learning has emerged as a powerful tool for unsupervised graph representation learning. The key to the success of graph contrastive learning is to acquire high-quality positive and negative samples as contrasting pairs for the purpose of learning underlying structural semantics of the input graph. Recent works usually sample negative samples from the same training batch with the positive samples, or from an external irrelevant graph. However, a significant limitation lies in such strategies, which is the unavoidable problem of sampling false negative samples. In this paper, we propose a novel method to utilize \textbf{C}ounterfactual mechanism to generate artificial hard negative samples for \textbf{G}raph \textbf{C}ontrastive learning, namely \textbf{CGC}, which has a different perspective compared to those sampling-based strategies. We utilize counterfactual mechanism to produce hard negative samples, which ensures that the generated samples are similar to, but have labels that different from the positive sample. The proposed method achieves satisfying results on several datasets compared to some traditional unsupervised graph learning methods and some SOTA graph contrastive learning methods. We also conduct some supplementary experiments to give an extensive illustration of the proposed method, including the performances of CGC with different hard negative samples and evaluations for hard negative samples generated with different similarity measurements.

📄 PDF Abstract BibTeX arXiv:2207.00148

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningcounterfactualGraph LearningGraph Representation LearningRepresentation Learning

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

DropMix: Better Graph Contrastive Learning with Harder Negative Samples

2023-10-15 · Yueqi Ma, Minjie Chen, Xiang Li

While generating better negative samples for contrastive learning has been widely studied in the areas of CV and NLP, very few work has focused on graph-structured data. Recently, Mixup has been introduced to synthesize …

Contrastive Learning

MixKG: Mixing for harder negative samples in knowledge graph

2022-02-19 · Feihu Che, Guohua Yang, Pengpeng Shao, Dawei Zhang 외

Knowledge graph embedding~(KGE) aims to represent entities and relations into low-dimensional vectors for many real-world applications. The representations of entities and relations are learned via contrasting the positi…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graphs

$m$-mix: Generating hard negatives via multiple samples mixing for contrastive learning

2021-09-29 · Shaofeng Zhang, Meng Liu, Junchi Yan, Hengrui Zhang 외

Negative pairs are essential in contrastive learning, which plays the role of avoiding degenerate solutions. Hard negatives can improve the representation ability on the basis of common negatives. Inspired by recent hard…

ClassificationContrastive LearningGraph Classificationimage-classification+2

Generating Robust Counterfactual Witnesses for Graph Neural Networks

2024-04-30 · Dazhuo Qiu, Mengying Wang, Arijit Khan, Yinghui Wu

This paper introduces a new class of explanation structures, called robust counterfactual witnesses (RCWs), to provide robust, both counterfactual and factual explanations for graph neural networks. Given a graph neural …

counterfactualExplanation GenerationGraph Neural NetworkNode Classification

Globally Correlation-Aware Hard Negative Generation

2024-11-20 · Wenjie Peng, Hongxiang Huang, Tianshui Chen, Quhui Ke 외

Hard negative generation aims to generate informative negative samples that help to determine the decision boundaries and thus facilitate advancing deep metric learning. Current works select pair/triplet samples, learn t…

Image RetrievalMetric LearningTriplet