Enhancing Contrastive Link Prediction With Edge Balancing Augmentation
Link prediction is one of the most fundamental tasks in graph mining, which motivates the recent studies of leveraging contrastive learning to enhance the performance. However, we observe two major weaknesses of these studies: i) the lack of theoretical analysis for contrastive learning on link prediction, and ii) inadequate consideration of node degrees in contrastive learning. To address the above weaknesses, we provide the first formal theoretical analysis for contrastive learning on link prediction, where our analysis results can generalize to the autoencoder-based link prediction models with contrastive learning. Motivated by our analysis results, we propose a new graph augmentation approach, Edge Balancing Augmentation (EBA), which adjusts the node degrees in the graph as the augmentation. We then propose a new approach, named Contrastive Link Prediction with Edge Balancing Augmentation (CoEBA), that integrates the proposed EBA and the proposed new contrastive losses to improve the model performance. We conduct experiments on 8 benchmark datasets. The results demonstrate that our proposed CoEBA significantly outperforms the other state-of-the-art link prediction models.
Code (0)
등록된 구현이 없습니다.
Tasks
Contrastive LearningLink PredictionSimilar Papers 제목 키워드 기반
SMiLE: Schema-augmented Multi-level Contrastive Learning for Knowledge Graph Link Prediction
Link prediction is the task of inferring missing links between entities in knowledge graphs. Embedding-based methods have shown effectiveness in addressing this problem by modeling relational patterns in triples. However…
Contrastive LearningKnowledge GraphsLink PredictionPredictionBi-Link: Bridging Inductive Link Predictions from Text via Contrastive Learning of Transformers and Prompts
Inductive knowledge graph completion requires models to comprehend the underlying semantics and logic patterns of relations. With the advance of pretrained language models, recent research have designed transformers for …
Contrastive LearningEntity LinkingInductive knowledge graph completionKnowledge Graph Completion+3On the Sweet Spot of Contrastive Views for Knowledge-enhanced Recommendation
In recommender systems, knowledge graph (KG) can offer critical information that is lacking in the original user-item interaction graph (IG). Recent process has explored this direction and shows that contrastive learning…
ArticlesContrastive LearningRecommendation SystemsMitigating Hallucination in Visual-Language Models via Re-Balancing Contrastive Decoding
Although Visual-Language Models (VLMs) have shown impressive capabilities in tasks like visual question answering and image captioning, they still struggle with hallucinations. Analysis of attention distribution in these…
HallucinationImage CaptioningQuestion AnsweringVisual Question AnsweringLine Graph Contrastive Learning for Link Prediction
Link prediction tasks focus on predicting possible future connections. Most existing researches measure the likelihood of links by different similarity scores on node pairs and predict links between nodes. However, the s…
Contrastive LearningLink PredictionNode ClassificationPrediction