paper-with-me

Papers

Structure Aware Negative Sampling in Knowledge Graphs

2020-09-23 · EMNLP 2020 11 · Kian Ahrabian, Aarash Feizi, Yasmin Salehi, William L. Hamilton, Avishek Joey Bose

Learning low-dimensional representations for entities and relations in knowledge graphs using contrastive estimation represents a scalable and effective method for inferring connectivity patterns. A crucial aspect of contrastive learning approaches is the choice of corruption distribution that generates hard negative samples, which force the embedding model to learn discriminative representations and find critical characteristics of observed data. While earlier methods either employ too simple corruption distributions, i.e. uniform, yielding easy uninformative negatives or sophisticated adversarial distributions with challenging optimization schemes, they do not explicitly incorporate known graph structure resulting in suboptimal negatives. In this paper, we propose Structure Aware Negative Sampling (SANS), an inexpensive negative sampling strategy that utilizes the rich graph structure by selecting negative samples from a node's k-hop neighborhood. Empirically, we demonstrate that SANS finds semantically meaningful negatives and is competitive with SOTA approaches while requires no additional parameters nor difficult adversarial optimization.

📄 PDF Abstract BibTeX arXiv:2009.11355

Code (0)

등록된 구현이 없습니다.

Tasks

Contrastive LearningKnowledge Graphs

Methods 이 논문이 사용한 방법론

Contrastive Learning 설명 없음

Similar Papers 제목 키워드 기반

Subgraph-Aware Training of Language Models for Knowledge Graph Completion Using Structure-Aware Contrastive Learning

2024-07-17 · Youmin Ko, Hyemin Yang, Taeuk Kim, Hyunjoon Kim

Fine-tuning pre-trained language models (PLMs) has recently shown a potential to improve knowledge graph completion (KGC). However, most PLM-based methods focus solely on encoding textual information, neglecting the long…

Contrastive LearningInductive BiasKnowledge Graph CompletionKnowledge Graphs

Analysis of the Impact of Negative Sampling on Link Prediction in Knowledge Graphs

2017-08-22 · Bhushan Kotnis, Vivi Nastase

Knowledge graphs are large, useful, but incomplete knowledge repositories. They encode knowledge through entities and relations which define each other through the connective structure of the graph. This has inspired met…

Knowledge Graph EmbeddingsKnowledge GraphsLink Prediction

Diversified and Adaptive Negative Sampling on Knowledge Graphs

2024-10-10 · Ran Liu, Zhongzhou Liu, XiaoLi Li, Hao Wu 외

In knowledge graph embedding, aside from positive triplets (ie: facts in the knowledge graph), the negative triplets used for training also have a direct influence on the model performance. In reality, since knowledge gr…

Graph EmbeddingInformativenessKnowledge Graph EmbeddingKnowledge Graphs+1

MoCoSA: Momentum Contrast for Knowledge Graph Completion with Structure-Augmented Pre-trained Language Models

2023-08-16 · Jiabang He, Liu Jia, Lei Wang, Xiyao Li 외

Knowledge Graph Completion (KGC) aims to conduct reasoning on the facts within knowledge graphs and automatically infer missing links. Existing methods can mainly be categorized into structure-based or description-based.…

Entity EmbeddingsKnowledge Graph CompletionKnowledge GraphsLink Prediction

CAKE: A Scalable Commonsense-Aware Framework For Multi-View Knowledge Graph Completion

2022-02-25 · ACL 2022 5 · Guanglin Niu, Bo Li, Yongfei Zhang, ShiLiang Pu

Knowledge graphs store a large number of factual triples while they are still incomplete, inevitably. The previous knowledge graph completion (KGC) models predict missing links between entities merely relying on fact-vie…

Graph EmbeddingKnowledge Graph CompletionKnowledge Graph EmbeddingKnowledge Graphs+1