Large Language Models for Knowledge Graph Embedding Techniques, Methods, and Challenges: A Survey
Large Language Models (LLMs) have attracted a lot of attention in various fields due to their superior performance, aiming to train hundreds of millions or more parameters on large amounts of text data to understand and generate natural language. As the superior performance of LLMs becomes apparent, they are increasingly being applied to knowledge graph embedding (KGE) related tasks to improve the processing results. As a deep learning model in the field of Natural Language Processing (NLP), it learns a large amount of textual data to predict the next word or generate content related to a given text. However, LLMs have recently been invoked to varying degrees in different types of KGE related scenarios such as multi-modal KGE and open KGE according to their task characteristics. In this paper, we investigate a wide range of approaches for performing LLMs-related tasks in different types of KGE scenarios. To better compare the various approaches, we summarize each KGE scenario in a classification. In addition to the categorization methods, we provide a tabular overview of the methods and their source code links for a more direct comparison. In the article we also discuss the applications in which the methods are mainly used and suggest several forward-looking directions for the development of this new research area.
Code (0)
등록된 구현이 없습니다.
Tasks
Graph EmbeddingKnowledge Graph EmbeddingMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Structured Query Construction via Knowledge Graph Embedding
In order to facilitate the accesses of general users to knowledge graphs, an increasing effort is being exerted to construct graph-structured queries of given natural language questions. At the core of the construction i…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsInjecting Knowledge Graphs into Large Language Models
Integrating structured knowledge from Knowledge Graphs (KGs) into Large Language Models (LLMs) remains a key challenge for symbolic reasoning. Existing methods mainly rely on prompt engineering or fine-tuning, which lose…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsPrompt EngineeringVisualization of Knowledge Graphs with Embeddings: an Essay on Recent Trends and Methods
In this essay we discuss the recent trends in visual analysis and exploration of Knowledge Graphs, particularly in conjunction with Knowledge Graph Embedding techniques. We present an overview of the current state of vis…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge Graph EmbeddingsKnowledge Graphs+1A Survey of Embedding Space Alignment Methods for Language and Knowledge Graphs
Neural embedding approaches have become a staple in the fields of computer vision, natural language processing, and more recently, graph analytics. Given the pervasive nature of these algorithms, the natural question bec…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsSentence+1Knowledge Graph Refinement based on Triplet BERT-Networks
Knowledge graph embedding techniques are widely used for knowledge graph refinement tasks such as graph completion and triple classification. These techniques aim at embedding the entities and relations of a Knowledge Gr…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsRelation+3