paper-with-me

홈 › Papers

Large Language Models for Knowledge Graph Embedding Techniques, Methods, and Challenges: A Survey

2025-01-14 · Bingchen Liu, Xin Li

Large Language Models (LLMs) have attracted a lot of attention in various fields due to their superior performance, aiming to train hundreds of millions or more parameters on large amounts of text data to understand and generate natural language. As the superior performance of LLMs becomes apparent, they are increasingly being applied to knowledge graph embedding (KGE) related tasks to improve the processing results. As a deep learning model in the field of Natural Language Processing (NLP), it learns a large amount of textual data to predict the next word or generate content related to a given text. However, LLMs have recently been invoked to varying degrees in different types of KGE related scenarios such as multi-modal KGE and open KGE according to their task characteristics. In this paper, we investigate a wide range of approaches for performing LLMs-related tasks in different types of KGE scenarios. To better compare the various approaches, we summarize each KGE scenario in a classification. In addition to the categorization methods, we provide a tabular overview of the methods and their source code links for a more direct comparison. In the article we also discuss the applications in which the methods are mainly used and suggest several forward-looking directions for the development of this new research area.

📄 PDF Abstract BibTeX arXiv:2501.07766

Code (0)

등록된 구현이 없습니다.

Tasks

Graph EmbeddingKnowledge Graph Embedding

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Attention 설명 없음

Similar Papers 제목 키워드 기반

Structured Query Construction via Knowledge Graph Embedding

2019-09-06 · Ruijie Wang, Meng Wang, Jun Liu, Michael Cochez 외

In order to facilitate the accesses of general users to knowledge graphs, an increasing effort is being exerted to construct graph-structured queries of given natural language questions. At the core of the construction i…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graphs

Injecting Knowledge Graphs into Large Language Models

2025-05-12 · Erica Coppolillo

Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsPrompt Engineering

Visualization of Knowledge Graphs with Embeddings: an Essay on Recent Trends and Methods

2024-11-21 · Davide Riva, Cristina Rossetti

In this essay we discuss the recent trends in visual analysis and exploration of Knowledge Graphs, particularly in conjunction with Knowledge Graph Embedding techniques. We present an overview of the current state of vis…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsKnowledge Graphs+1

A Survey of Embedding Space Alignment Methods for Language and Knowledge Graphs

2020-10-26 · Alexander Kalinowski, Yuan An

Neural embedding approaches have become a staple in the fields of computer vision, natural language processing, and more recently, graph analytics. Given the pervasive nature of these algorithms, the natural question bec…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsSentence+1

Knowledge Graph Refinement based on Triplet BERT-Networks

2022-11-18 · Armita Khajeh Nassiri, Nathalie Pernelle, Fatiha Sais, Gianluca Quercini

Knowledge graph embedding techniques are widely used for knowledge graph refinement tasks such as graph completion and triple classification. These techniques aim at embedding the entities and relations of a Knowledge Gr…

Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsRelation+3