paper-with-me

Papers

DSparsE: Dynamic Sparse Embedding for Knowledge Graph Completion

2024-09-22 · Chuhong Yang, Bin Li, Nan Wu

Addressing the incompleteness problem in knowledge graph remains a significant challenge. Current knowledge graph completion methods have their limitations. For example, ComDensE is prone to overfitting and suffers from the degradation with the increase of network depth while InteractE has the limitations in feature interaction and interpretability. To this end, we propose a new method called dynamic sparse embedding (DSparsE) for knowledge graph completion. The proposed model embeds the input entity-relation pairs by a shallow encoder composed of a dynamic layer and a relation-aware layer. Subsequently, the concatenated output of the dynamic layer and relation-aware layer is passed through a projection layer and a deep decoder with residual connection structure. This model ensures the network robustness and maintains the capability of feature extraction. Furthermore, the conventional dense layers are replaced by randomly initialized sparse connection layers in the proposed method, which can mitigate the model overfitting. Finally, comprehensive experiments are conducted on the datasets of FB15k-237, WN18RR and YAGO3-10. It was demonstrated that the proposed method achieves the state-of-the-art performance in terms of Hits@1 compared to the existing baseline approaches. An ablation study is performed to examine the effects of the dynamic layer and relation-aware layer, where the combined model achieves the best performance.

📄 PDF Abstract BibTeX arXiv:2410.07140

Code (0)

등록된 구현이 없습니다.

Tasks

DecoderKnowledge Graph CompletionRelation

Methods 이 논문이 사용한 방법론

Residual Connection 설명 없음

Similar Papers 제목 키워드 기반

Outcome-guided Sparse K-means for Disease Subtype Discovery via Integrating Phenotypic Data with High-dimensional Transcriptomic Data

2021-03-18 · Lingsong Meng, Dorina Avram, George Tseng, Zhiguang Huo

The discovery of disease subtypes is an essential step for developing precision medicine, and disease subtyping via omics data has become a popular approach. While promising, subtypes obtained from existing approaches ar…

ClusteringEpidemiology

An Expectation-Maximization Perspective on Federated Learning

2021-11-19 · Christos Louizos, Matthias Reisser, Joseph Soriaga, Max Welling

Federated learning describes the distributed training of models across multiple clients while keeping the data private on-device. In this work, we view the server-orchestrated federated learning process as a hierarchical…

Federated Learning

Improving Graph Embeddings in Machine Learning Using Knowledge Completion with Validation in a Case Study on COVID-19 Spread

2025-11-15 · Rosario Napoli, Gabriele Morabito, Antonio Celesti, Massimo Villari 외 arxiv

The rise of graph-structured data has driven major advances in Graph Machine Learning (GML), where graph embeddings (GEs) map features from Knowledge Graphs (KGs) into vector spaces, enabling tasks like node classificati…

Node ClassificationKnowledge GraphsLink Prediction

Dynamic Anticipation and Completion for Multi-Hop Reasoning over Sparse Knowledge Graph

2020-10-05 · EMNLP 2020 11 · Xin Lv, Xu Han, Lei Hou, Juanzi Li 외

Multi-hop reasoning has been widely studied in recent years to seek an effective and interpretable method for knowledge graph (KG) completion. Most previous reasoning methods are designed for dense KGs with enough paths …

SparseTransX: Efficient Training of Translation-Based Knowledge Graph Embeddings Using Sparse Matrix Operations

2025-02-24 · Md Saidul Hoque Anik, Ariful Azad

Knowledge graph (KG) learning offers a powerful framework for generating new knowledge and making inferences. Training KG embedding can take a significantly long time, especially for larger datasets. Our analysis shows t…

CPUGPUKnowledge Graph EmbeddingsTranslation