paper-with-me

Papers

Rethinking Regularization Methods for Knowledge Graph Completion

2025-05-29 · Linyu Li, Zhi Jin, Yuanpeng He, Dongming Jin, Haoran Duan, Zhengwei Tao, Xuan Zhang, Jiandong Li

Knowledge graph completion (KGC) has attracted considerable attention in recent years because it is critical to improving the quality of knowledge graphs. Researchers have continuously explored various models. However, most previous efforts have neglected to take advantage of regularization from a deeper perspective and therefore have not been used to their full potential. This paper rethinks the application of regularization methods in KGC. Through extensive empirical studies on various KGC models, we find that carefully designed regularization not only alleviates overfitting and reduces variance but also enables these models to break through the upper bounds of their original performance. Furthermore, we introduce a novel sparse-regularization method that embeds the concept of rank-based selective sparsity into the KGC regularizer. The core idea is to selectively penalize those components with significant features in the embedding vector, thus effectively ignoring many components that contribute little and may only represent noise. Various comparative experiments on multiple datasets and multiple models show that the SPR regularization method is better than other regularization methods and can enable the KGC model to further break through the performance margin.

📄 PDF Abstract BibTeX arXiv:2505.23442

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graph CompletionKnowledge Graphs

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Convolutional Geometric Matrix Completion

2018-03-02 · Kai-Lang Yao, Wu-Jun Li, Jianbo Yang, Xinyan Lu

Geometric matrix completion (GMC) has been proposed for recommendation by integrating the relationship (link) graphs among users/items into matrix completion (MC). Traditional GMC methods typically adopt graph regulariza…

Matrix Completion

Knowledge Graph Completion with Text-aided Regularization

2021-01-22 · Tong Chen, Sirou Zhu, Yiming Wen, Zhaomin Zheng

Knowledge Graph Completion is a task of expanding the knowledge graph/base through estimating possible entities, or proper nouns, that can be connected using a set of predefined relations, or verb/predicates describing i…

Knowledge Graph Completion

Knowledge Graph Completion as Tensor Decomposition: A Genreal Form and Tensor N-rank Regularization

2021-09-29 · Changyi Xiao, Xiangnan He, Yixin Cao

Knowledge graph completion (KGC) is a 3rd-order binary tensor completion task. Tensor decomposition based (TDB) models have shown great performance in KGC. In this paper, we summarize existing TDB models and derive a gen…

FormKnowledge Graph CompletionTensor Decomposition

Tucker decomposition-based Temporal Knowledge Graph Completion

2020-11-16 · Pengpeng Shao, Guohua Yang, Dawei Zhang, JianHua Tao 외

Knowledge graphs have been demonstrated to be an effective tool for numerous intelligent applications. However, a large amount of valuable knowledge still exists implicitly in the knowledge graphs. To enrich the existing…

Knowledge Graph CompletionKnowledge GraphsLink PredictionTemporal Knowledge Graph Completion+1

Traversing Knowledge Graphs in Vector Space

2015-06-03 · EMNLP 2015 9 · Kelvin Guu, John Miller, Percy Liang

Path queries on a knowledge graph can be used to answer compositional questions such as "What languages are spoken by people living in Lisbon?". However, knowledge graphs often have missing facts (edges) which disrupts p…

Knowledge Base CompletionKnowledge Graphs