paper-with-me

Papers

HGE: Embedding Temporal Knowledge Graphs in a Product Space of Heterogeneous Geometric Subspaces

2023-12-21 · Jiaxin Pan, Mojtaba Nayyeri, Yinan Li, Steffen Staab

Temporal knowledge graphs represent temporal facts $(s,p,o,\tau)$ relating a subject $s$ and an object $o$ via a relation label $p$ at time $\tau$, where $\tau$ could be a time point or time interval. Temporal knowledge graphs may exhibit static temporal patterns at distinct points in time and dynamic temporal patterns between different timestamps. In order to learn a rich set of static and dynamic temporal patterns and apply them for inference, several embedding approaches have been suggested in the literature. However, as most of them resort to single underlying embedding spaces, their capability to model all kinds of temporal patterns was severely limited by having to adhere to the geometric property of their one embedding space. We lift this limitation by an embedding approach that maps temporal facts into a product space of several heterogeneous geometric subspaces with distinct geometric properties, i.e.\ Complex, Dual, and Split-complex spaces. In addition, we propose a temporal-geometric attention mechanism to integrate information from different geometric subspaces conveniently according to the captured relational and temporal information. Experimental results on standard temporal benchmark datasets favorably evaluate our approach against state-of-the-art models.

📄 PDF Abstract BibTeX arXiv:2312.13680

Code (1)

NacyNiko/HGE 공식 구현 pytorch

Tasks

Knowledge Graphs

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

DyERNIE: Dynamic Evolution of Riemannian Manifold Embeddings for Temporal Knowledge Graph Completion

2020-11-08 · EMNLP 2020 11 · Zhen Han, Yunpu Ma, Peng Chen, Volker Tresp

There has recently been increasing interest in learning representations of temporal knowledge graphs (KGs), which record the dynamic relationships between entities over time. Temporal KGs often exhibit multiple simultane…

Knowledge Graph CompletionKnowledge GraphsRepresentation LearningTemporal Knowledge Graph Completion

Duality-Induced Regularizer for Semantic Matching Knowledge Graph Embeddings

2022-03-24 · Jie Wang, Zhanqiu Zhang, Zhihao Shi, Jianyu Cai 외

Semantic matching models -- which assume that entities with similar semantics have similar embeddings -- have shown great power in knowledge graph embeddings (KGE). Many existing semantic matching models use inner produc…

Entity EmbeddingsKnowledge Graph EmbeddingsKnowledge Graphs

Geometric Algebra based Embeddings for Static and Temporal Knowledge Graph Completion

2022-02-18 · Chengjin Xu, Mojtaba Nayyeri, Yung-Yu Chen, Jens Lehmann

Recent years, Knowledge Graph Embeddings (KGEs) have shown promising performance on link prediction tasks by mapping the entities and relations from a Knowledge Graph (KG) into a geometric space and thus have gained incr…

Knowledge Graph CompletionKnowledge Graph EmbeddingsKnowledge GraphsLink Prediction+3

Bending the Future: Autoregressive Modeling of Temporal Knowledge Graphs in Curvature-Variable Hyperbolic Spaces

2022-09-12 · Jihoon Sohn, Mingyu Derek Ma, Muhao Chen

Recently there is an increasing scholarly interest in time-varying knowledge graphs, or temporal knowledge graphs (TKG). Previous research suggests diverse approaches to TKG reasoning that uses historical information. Ho…

Knowledge Graphs

Improving Heterogeneous Graph Learning with Weighted Mixed-Curvature Product Manifold

2023-07-10 · Tuc Nguyen-Van, Dung D. Le, The-Anh Ta

In graph representation learning, it is important that the complex geometric structure of the input graph, e.g. hidden relations among nodes, is well captured in embedding space. However, standard Euclidean embedding spa…

Graph EmbeddingGraph LearningGraph Representation LearningKnowledge Graph Embedding+2