Efficient Relation-aware Scoring Function Search for Knowledge Graph Embedding
The scoring function, which measures the plausibility of triplets in knowledge graphs (KGs), is the key to ensure the excellent performance of KG embedding, and its design is also an important problem in the literature. Automated machine learning (AutoML) techniques have recently been introduced into KG to design task-aware scoring functions, which achieve state-of-the-art performance in KG embedding. However, the effectiveness of searched scoring functions is still not as good as desired. In this paper, observing that existing scoring functions can exhibit distinct performance on different semantic patterns, we are motivated to explore such semantics by searching relation-aware scoring functions. But the relation-aware search requires a much larger search space than the previous one. Hence, we propose to encode the space as a supernet and propose an efficient alternative minimization algorithm to search through the supernet in a one-shot manner. Finally, experimental results on benchmark datasets demonstrate that the proposed method can efficiently search relation-aware scoring functions, and achieve better embedding performance than state-of-the-art methods.
Code (3)
Tasks
AutoMLGraph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsRelationSimilar Papers 제목 키워드 기반
Bilinear Scoring Function Search for Knowledge Graph Learning
Learning embeddings for entities and relations in knowledge graph (KG) have benefited many downstream tasks. In recent years, scoring functions, the crux of KG learning, have been human-designed to measure the plausibili…
AutoMLGraph EmbeddingGraph LearningKnowledge Graph EmbeddingAutoWeird: Weird Translational Scoring Function Identified by Random Search
Scoring function (SF) measures the plausibility of triplets in knowledge graphs. Different scoring functions can lead to huge differences in link prediction performances on different knowledge graphs. In this report, we …
AttributeKnowledge GraphsLink PredictionTripletA Survey on Knowledge Graphs: Representation, Acquisition and Applications
Human knowledge provides a formal understanding of the world. Knowledge graphs that represent structural relations between entities have become an increasingly popular research direction towards cognition and human-level…
Graph EmbeddingGraph Representation LearningKnowledge Graph CompletionKnowledge Graph Embedding+5Knowledge-Aware Query Expansion with Large Language Models for Textual and Relational Retrieval
Large language models (LLMs) have been used to generate query expansions augmenting original queries for improving information search. Recent studies also explore providing LLMs with initial retrieval results to generate…
RetrievalMDistMult: A Multiple Scoring Functions Model for Link Prediction on Antiviral Drugs Knowledge Graph
Knowledge graphs (KGs) on COVID-19 have been constructed to accelerate the research process of COVID-19. However, KGs are always incomplete, especially the new constructed COVID-19 KGs. Link prediction task aims to predi…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink Prediction+1