paper-with-me

홈 › Papers

HopfE: Knowledge Graph Representation Learning using Inverse Hopf Fibrations

2021-08-12 · Anson Bastos, Kuldeep Singh, Abhishek Nadgeri, Saeedeh Shekarpour, Isaiah Onando Mulang, Johannes Hoffart

Recently, several Knowledge Graph Embedding (KGE) approaches have been devised to represent entities and relations in dense vector space and employed in downstream tasks such as link prediction. A few KGE techniques address interpretability, i.e., mapping the connectivity patterns of the relations (i.e., symmetric/asymmetric, inverse, and composition) to a geometric interpretation such as rotations. Other approaches model the representations in higher dimensional space such as four-dimensional space (4D) to enhance the ability to infer the connectivity patterns (i.e., expressiveness). However, modeling relation and entity in a 4D space often comes at the cost of interpretability. This paper proposes HopfE, a novel KGE approach aiming to achieve the interpretability of inferred relations in the four-dimensional space. We first model the structural embeddings in 3D Euclidean space and view the relation operator as an SO(3) rotation. Next, we map the entity embedding vector from a 3D space to a 4D hypersphere using the inverse Hopf Fibration, in which we embed the semantic information from the KG ontology. Thus, HopfE considers the structural and semantic properties of the entities without losing expressivity and interpretability. Our empirical results on four well-known benchmarks achieve state-of-the-art performance for the KG completion task.

📄 PDF Abstract BibTeX arXiv:2108.05774

Code (1)

ansonb/hopfe 공식 구현 pytorch

Tasks

Graph EmbeddingGraph Representation LearningKnowledge Graph EmbeddingLink PredictionRelationRepresentation Learning

Similar Papers 제목 키워드 기반

Coupled Inference in Diffusion Models for Semantic Decomposition

2026-02-10 · Calvin Yeung, Ali Zakeri, Zhuowen Zou, Mohsen Imani arxiv

Many visual scenes can be described as compositions of latent factors. Effective recognition, reasoning, and editing often require not only forming such compositional representations, but also solving the decomposition p…

HLTRI at W-NUT 2020 Shared Task-3: COVID-19 Event Extraction from Twitter Using Multi-Task Hopfield Pooling

2020-11-01 · EMNLP (WNUT) 2020 11 · Maxwell Weinzierl, Sanda Harabagiu

Extracting structured knowledge involving self-reported events related to the COVID-19 pandemic from Twitter has the potential to inform surveillance systems that play a critical role in public health. The event extracti…

Event ExtractionLanguage ModelingLanguage Modelling

Graph Hopfield Networks: Energy-Based Node Classification with Associative Memory

2026-03-03 · Abinav Rao, Alex Wa, Rishi Athavale arxiv

We introduce Graph Hopfield Networks, whose energy function couples associative memory retrieval with graph Laplacian smoothing for node classification. Gradient descent on this joint energy yields an iterative update in…

Node Classification

Exploring the Temperature-Dependent Phase Transition in Modern Hopfield Networks

2023-11-30 · Felix Koulischer, Cédric Goemaere, Tom Van Der Meersch, Johannes Deleu 외

The recent discovery of a connection between Transformers and Modern Hopfield Networks (MHNs) has reignited the study of neural networks from a physical energy-based perspective. This paper focuses on the pivotal effect …

STanHop: Sparse Tandem Hopfield Model for Memory-Enhanced Time Series Prediction

2023-12-28 · Dennis Wu, Jerry Yao-Chieh Hu, Weijian Li, Bo-Yu Chen 외

We present STanHop-Net (Sparse Tandem Hopfield Network) for multivariate time series prediction with memory-enhanced capabilities. At the heart of our approach is STanHop, a novel Hopfield-based neural network block, whi…

RetrievalTime SeriesTime Series Prediction