paper-with-me

홈 › Papers

Evaluating the Impact of Knowledge Graph Context on Entity Disambiguation Models

2020-08-12 · Isaiah Onando Mulang', Kuldeep Singh, Chaitali Prabhu, Abhishek Nadgeri, Johannes Hoffart, Jens Lehmann

Pretrained Transformer models have emerged as state-of-the-art approaches that learn contextual information from text to improve the performance of several NLP tasks. These models, albeit powerful, still require specialized knowledge in specific scenarios. In this paper, we argue that context derived from a knowledge graph (in our case: Wikidata) provides enough signals to inform pretrained transformer models and improve their performance for named entity disambiguation (NED) on Wikidata KG. We further hypothesize that our proposed KG context can be standardized for Wikipedia, and we evaluate the impact of KG context on state-of-the-art NED model for the Wikipedia knowledge base. Our empirical results validate that the proposed KG context can be generalized (for Wikipedia), and providing KG context in transformer architectures considerably outperforms the existing baselines, including the vanilla transformer models.

📄 PDF Abstract BibTeX arXiv:2008.05190

Code (1)

mulangonando/Impact-of-KG-Context-on-ED 공식 구현 pytorch

Tasks

Entity Disambiguation

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Absolute Position Encodings Absolute Position Encodings are a type of position embeddings for [Transformer-based models] where positional encodings are…
Position-Wise Feed-Forward Layer 설명 없음
Layer Normalization Unlike batch normalization, Layer Normalization directly estimates the normalization statistics from the summed inputs…
Adam 설명 없음
Attention 설명 없음
Multi-Head Attention 설명 없음
BPE Byte Pair Encoding, or BPE, is a subword segmentation algorithm that encodes rare and unknown words as sequences of subword units. The intuition is that various word…

Similar Papers 제목 키워드 기반

KGPool: Dynamic Knowledge Graph Context Selection for Relation Extraction

2021-06-01 · Findings (ACL) 2021 8 · Abhishek Nadgeri, Anson Bastos, Kuldeep Singh, Isaiah Onando Mulang' 외

We present a novel method for relation extraction (RE) from a single sentence, mapping the sentence and two given entities to a canonical fact in a knowledge graph (KG). Especially in this presumed sentential RE setting,…

Graph Neural NetworkRelationRelation ExtractionRelationship Extraction (Distant Supervised)+1

FusionMind -- Improving question and answering with external context fusion

2023-12-31 · Shreyas Verma, Manoj Parmar, Palash Choudhary, Sanchita Porwal

Answering questions using pre-trained language models (LMs) and knowledge graphs (KGs) presents challenges in identifying relevant knowledge and performing joint reasoning.We compared LMs (fine-tuned for the task) with t…

Knowledge GraphsMultiple-choiceQuestion Answering

Is Knowledge Embedding Fully Exploited in Language Understanding? An Empirical Study

2021-05-16 · ACL ARR May 2021 5 · Anonymous

The recent development of knowledge embedding (KE) enables machines to represent knowledge graphs (KGs) with low-dimensional embeddings, which facilitates utilizing KGs for various downstream natural language understandi…

Knowledge Graph CompletionKnowledge GraphsNatural Language Understanding

GE-Blender: Graph-Based Knowledge Enhancement for Blender

2023-01-30 · Xiaolei Lian, Xunzhu Tang, Yue Wang

Although the great success of open-domain dialogue generation, unseen entities can have a large impact on the dialogue generation task. It leads to performance degradation of the model in the dialog generation. Previous …

Dialogue GenerationTAG

Context-Enhanced Entity and Relation Embedding for Knowledge Graph Completion

2020-12-13 · Ziyue Qiao, Zhiyuan Ning, Yi Du, Yuanchun Zhou

Most researches for knowledge graph completion learn representations of entities and relations to predict missing links in incomplete knowledge graphs. However, these methods fail to take full advantage of both the conte…

Knowledge Graph CompletionKnowledge GraphsRelation