Knowledge Base Completion: Baselines Strike Back
Many papers have been published on the knowledge base completion task in the past few years. Most of these introduce novel architectures for relation learning that are evaluated on standard datasets such as FB15k and WN18. This paper shows that the accuracy of almost all models published on the FB15k can be outperformed by an appropriately tuned baseline - our reimplementation of the DistMult model. Our findings cast doubt on the claim that the performance improvements of recent models are due to architectural changes as opposed to hyper-parameter tuning or different training objectives. This should prompt future research to re-consider how the performance of models is evaluated and reported.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge Base CompletionSimilar Papers 제목 키워드 기반
Knowledge Base Completion: Baseline strikes back (Again)
Knowledge Base Completion (KBC) has been a very active area lately. Several recent KBCpapers propose architectural changes, new training methods, or even new formulations. KBC systems are usually evaluated on standard be…
AllKnowledge Base CompletionKnowledge Base PopulationKnowledge Graph Completion+3Few-Shot Knowledge Graph Completion with Data Fusion and Augmentation
This paper addresses the few-shot knowledge graph completion problem, which aims to infer facts for long-tail distributed relations for completing knowledge graphs. The few-shot knowledge graph completion task confronts …
Few-Shot LearningKnowledge Graph CompletionKnowledge GraphsWorld KnowledgeKnowledge Is Flat: A Seq2Seq Generative Framework for Various Knowledge Graph Completion
Knowledge Graph Completion (KGC) has been recently extended to multiple knowledge graph (KG) structures, initiating new research directions, e.g. static KGC, temporal KGC and few-shot KGC. Previous works often design KGC…
Knowledge Graph CompletionSTRIKE: Additive Feature-Group-Aware Stacking Framework for Credit Default Prediction
Credit risk default prediction remains a cornerstone of risk management in the financial industry. The task involves estimating the likelihood that a borrower will fail to meet debt obligations, an objective critical for…
Portfolio OptimizationAn Interpretable Knowledge Transfer Model for Knowledge Base Completion
Knowledge bases are important resources for a variety of natural language processing tasks but suffer from incompleteness. We propose a novel embedding model, \emph{ITransF}, to perform knowledge base completion. Equippe…
Knowledge Base CompletionTransfer Learning