paper-with-me

홈 › Papers

Enhancing Knowledge Graph Completion with GNN Distillation and Probabilistic Interaction Modeling

2025-05-18 · Lingzhi Wang, Pengcheng Huang, Haotian Li, Yuliang Wei, Guodong Xin, Rui Zhang, Donglin Zhang, Zhenzhou Ji, Wei Wang

Knowledge graphs (KGs) serve as fundamental structures for organizing interconnected data across diverse domains. However, most KGs remain incomplete, limiting their effectiveness in downstream applications. Knowledge graph completion (KGC) aims to address this issue by inferring missing links, but existing methods face critical challenges: deep graph neural networks (GNNs) suffer from over-smoothing, while embedding-based models fail to capture abstract relational features. This study aims to overcome these limitations by proposing a unified framework that integrates GNN distillation and abstract probabilistic interaction modeling (APIM). GNN distillation approach introduces an iterative message-feature filtering process to mitigate over-smoothing, preserving the discriminative power of node representations. APIM module complements this by learning structured, abstract interaction patterns through probabilistic signatures and transition matrices, allowing for a richer, more flexible representation of entity and relation interactions. We apply these methods to GNN-based models and the APIM to embedding-based KGC models, conducting extensive evaluations on the widely used WN18RR and FB15K-237 datasets. Our results demonstrate significant performance gains over baseline models, showcasing the effectiveness of the proposed techniques. The findings highlight the importance of both controlling information propagation and leveraging structured probabilistic modeling, offering new avenues for advancing knowledge graph completion. And our codes are available at https://anonymous.4open.science/r/APIM_and_GNN-Distillation-461C.

📄 PDF Abstract BibTeX arXiv:2505.12272

Code (0)

등록된 구현이 없습니다.

Tasks

Knowledge Graph CompletionKnowledge Graphs

Similar Papers 제목 키워드 기반

CasPoinTr: Point Cloud Completion with Cascaded Networks and Knowledge Distillation

2025-09-27 · Yifan Yang, Yuxiang Yan, Boda Liu, Jian Pu arxiv

Point clouds collected from real-world environments are often incomplete due to factors such as limited sensor resolution, single viewpoints, occlusions, and noise. These challenges make point cloud completion essential …

Knowledge DistillationPoint Cloud CompletionPoint Clouds

Probabilistic Knowledge Graph Construction: Compositional and Incremental Approaches

2016-08-21 · Dongwoo Kim, Lexing Xie, Cheng Soon Ong

Knowledge graph construction consists of two tasks: extracting information from external resources (knowledge population) and inferring missing information through a statistical analysis on the extracted information (kno…

graph construction

Collective Knowledge Graph Completion with Mutual Knowledge Distillation

2023-05-25 · Weihang Zhang, Ovidiu Serban, Jiahao Sun, Yi-Ke Guo

Knowledge graph completion (KGC), the task of predicting missing information based on the existing relational data inside a knowledge graph (KG), has drawn significant attention in recent years. However, the predictive p…

Knowledge DistillationKnowledge Graph CompletionKnowledge GraphsTransfer Learning

Logical Entity Representation in Knowledge-Graphs for Differentiable Rule Learning

2023-05-22 · Chi Han, Qizheng He, Charles Yu, Xinya Du 외

Probabilistic logical rule learning has shown great strength in logical rule mining and knowledge graph completion. It learns logical rules to predict missing edges by reasoning on existing edges in the knowledge graph. …

Knowledge Graph CompletionKnowledge GraphsLink Prediction

Self-Distillation with Meta Learning for Knowledge Graph Completion

2023-05-20 · Findings of the Association for Computational Linguistics: EMNLP 2022 2022 12 · Yunshui Li, Junhao Liu, Chengming Li, Min Yang

In this paper, we propose a selfdistillation framework with meta learning(MetaSD) for knowledge graph completion with dynamic pruning, which aims to learn compressed graph embeddings and tackle the longtail samples. Spec…

Knowledge Graph CompletionMeta-LearningTransfer Learning