Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Models
Pretrained Transformer models have emerged as state-of-the-art approaches that learn contextual information from text to improve the performance of several NLP tasks. These models, albeit powerful, still require specialized knowledge in specific scenarios. In this paper, we argue that context derived from a knowledge graph (in our case: Wikidata) provides enough signals to inform pretrained transformer models and improve their performance for named entity disambiguation (NED) on Wikidata KG. We further hypothesize that our proposed KG context can be standardized for Wikipedia, and we evaluate the impact of KG context on state-of-the-art NED model for the Wikipedia knowledge base. Our empirical results validate that the proposed KG context can be generalized (for Wikipedia), and providing KG context in transformer architectures considerably outperforms the existing baselines, including the vanilla transformer models.
Code (1)
Tasks
Entity DisambiguationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
KGPool: Dynamic Knowledge Graph Context Selection for Relation Extraction
We present a novel method for relation extraction (RE) from a single sentence, mapping the sentence and two given entities to a canonical fact in a knowledge graph (KG). Especially in this presumed sentential RE setting,…
Graph Neural NetworkRelationRelation ExtractionRelationship Extraction (Distant Supervised)+1FusionMind -- Improving question and answering with external context fusion
Answering questions using pre-trained language models (LMs) and knowledge graphs (KGs) presents challenges in identifying relevant knowledge and performing joint reasoning.We compared LMs (fine-tuned for the task) with t…
Knowledge GraphsMultiple-choiceQuestion AnsweringIs Knowledge Embedding Fully Exploited in Language Understanding? An Empirical Study
The recent development of knowledge embedding (KE) enables machines to represent knowledge graphs (KGs) with low-dimensional embeddings, which facilitates utilizing KGs for various downstream natural language understandi…
Knowledge Graph CompletionKnowledge GraphsNatural Language UnderstandingGE-Blender: Graph-Based Knowledge Enhancement for Blender
Although the great success of open-domain dialogue generation, unseen entities can have a large impact on the dialogue generation task. It leads to performance degradation of the model in the dialog generation. Previous …
Dialogue GenerationTAGContext-Enhanced Entity and Relation Embedding for Knowledge Graph Completion
Most researches for knowledge graph completion learn representations of entities and relations to predict missing links in incomplete knowledge graphs. However, these methods fail to take full advantage of both the conte…
Knowledge Graph CompletionKnowledge GraphsRelation