paper-with-me

홈 › Papers

Multi-Partition Embedding Interaction with Block Term Format for Knowledge Graph Completion

2020-06-29 · Hung Nghiep Tran, Atsuhiro Takasu

Knowledge graph completion is an important task that aims to predict the missing relational link between entities. Knowledge graph embedding methods perform this task by representing entities and relations as embedding vectors and modeling their interactions to compute the matching score of each triple. Previous work has usually treated each embedding as a whole and has modeled the interactions between these whole embeddings, potentially making the model excessively expensive or requiring specially designed interaction mechanisms. In this work, we propose the multi-partition embedding interaction (MEI) model with block term format to systematically address this problem. MEI divides each embedding into a multi-partition vector to efficiently restrict the interactions. Each local interaction is modeled with the Tucker tensor format and the full interaction is modeled with the block term tensor format, enabling MEI to control the trade-off between expressiveness and computational cost, learn the interaction mechanisms from data automatically, and achieve state-of-the-art performance on the link prediction task. In addition, we theoretically study the parameter efficiency problem and derive a simple empirically verified criterion for optimal parameter trade-off. We also apply the framework of MEI to provide a new generalized explanation for several specially designed interaction mechanisms in previous models. The source code is released at https://github.com/tranhungnghiep/MEI-KGE.

📄 PDF Abstract BibTeX arXiv:2006.16365

Code (2)

tranhungnghiep/MEI-KGE 공식 구현 pytorch
tranhungnghiep/AnalyzeKGE tf

Tasks

Graph EmbeddingKnowledge Graph CompletionKnowledge Graph EmbeddingLink PredictionQuestion AnsweringRecommendation Systems

Methods 이 논문이 사용한 방법론

MEI MEI introduces the *multi-partition embedding interaction* technique with block term tensor format to systematically address the efficiency--expressiveness trade-off in…
TuckER TuckER

Similar Papers 제목 키워드 기반

MEIM: Multi-partition Embedding Interaction Beyond Block Term Format for Efficient and Expressive Link Prediction

2022-09-30 · Hung Nghiep Tran, Atsuhiro Takasu

Knowledge graph embedding aims to predict the missing relations between entities in knowledge graphs. Tensor-decomposition-based models, such as ComplEx, provide a good trade-off between efficiency and expressiveness, th…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsLink Prediction+2

Matching Latent Encoding for Audio-Text based Keyword Spotting

2023-06-08 · Kumari Nishu, Minsik Cho, Devang Naik

Using audio and text embeddings jointly for Keyword Spotting (KWS) has shown high-quality results, but the key challenge of how to semantically align two embeddings for multi-word keywords of different sequence lengths r…

Keyword Spotting

CropCap: Embedding Visual Cross-Partition Dependency for Image Captioning

2023-10-27 · journal 2023 10 · Bo wang, Zhao Zhang, Suiyi Zhao, Haijun Zhang 외

Transformer-based approaches to image captioning have shown great success by utilizing long-term dependency for visual embedding. However, their coarse long-term dependency, using the multi-head self-attention mechanism …

Image Captioning

UniMark: Unified Adaptive Multi-bit Watermarking for Autoregressive Image Generators

2026-04-12 · Yigit Yilmaz, Elena Petrova, Mehmet Kaya, Lucia Rossi 외 arxiv

Invisible watermarking for autoregressive (AR) image generation has recently gained attention as a means of protecting image ownership and tracing AI-generated content. However, existing approaches suffer from three key …

Semantic SimilarityImage Generation

Multi-Relational Embedding for Knowledge Graph Representation and Analysis

2020-09-28 · PhD Dissertation, The Graduate University for Advanced Studies, SOKENDAI, Japan 2020 9 · Hung Nghiep Tran

Multi-relational data, such as knowledge graphs, bibliographic data, and information networks are prevalent in real-world datasets. Managing, exploring, and utilizing these large and complex datasets effectively are chal…

Computational EfficiencyGraph EmbeddingKnowledge Graph CompletionKnowledge Graph Embedding+8