Construction of Knowledge Graph based on Language Model
Knowledge Graph (KG) can effectively integrate valuable information from massive data, and thus has been rapidly developed and widely used in many fields. Traditional KG construction methods rely on manual annotation, which often consumes a lot of time and manpower. And KG construction schemes based on deep learning tend to have weak generalization capabilities. With the rapid development of Pre-trained Language Models (PLM), PLM has shown great potential in the field of KG construction. This paper provides a comprehensive review of recent research advances in the field of construction of KGs using PLM. In this paper, we explain how PLM can utilize its language understanding and generation capabilities to automatically extract key information for KGs, such as entities and relations, from textual data. In addition, We also propose a new Hyper-Relarional Knowledge Graph construction framework based on lightweight Large Language Model (LLM) named LLHKG and compares it with previous methods. Under our framework, the KG construction capability of lightweight LLM is comparable to GPT3.5.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Assisted Knowledge Graph Authoring: Human-Supervised Knowledge Graph Construction from Natural Language
Encyclopedic knowledge graphs, such as Wikidata, host an extensive repository of millions of knowledge statements. However, domain-specific knowledge from fields such as history, physics, or medicine is significantly und…
graph constructionKnowledge GraphsRetrievalHierarchical Knowledge Graph Construction from Images for Scalable E-Commerce
Knowledge Graph (KG) is playing an increasingly important role in various AI systems. For e-commerce, an efficient and low-cost automated knowledge graph construction method is the foundation of enabling various successf…
Benchmarkinggraph constructionKnowledge GraphsLanguage Modeling+2Structured Query Construction via Knowledge Graph Embedding
In order to facilitate the accesses of general users to knowledge graphs, an increasing effort is being exerted to construct graph-structured queries of given natural language questions. At the core of the construction i…
Graph EmbeddingKnowledge Graph EmbeddingKnowledge GraphsSchema-aware Reference as Prompt Improves Data-Efficient Knowledge Graph Construction
With the development of pre-trained language models, many prompt-based approaches to data-efficient knowledge graph construction have been proposed and achieved impressive performance. However, existing prompt-based lear…
Event Extractiongraph constructionRepresentation LearningRetrievalGKG-LLM: A Unified Framework for Generalized Knowledge Graph Construction
The construction of Generalized Knowledge Graph (GKG), including knowledge graph, event knowledge graph and commonsense knowledge graph, is fundamental for various natural language processing tasks. Current studies typic…
graph constructionKnowledge Graphs