Entity-aware ELMo: Learning Contextual Entity Representation for Entity Disambiguation
We present a new local entity disambiguation system. The key to our system is a novel approach for learning entity representations. In our approach we learn an entity aware extension of Embedding for Language Model (ELMo) which we call Entity-ELMo (E-ELMo). Given a paragraph containing one or more named entity mentions, each mention is first defined as a function of the entire paragraph (including other mentions), then they predict the referent entities. Utilizing E-ELMo for local entity disambiguation, we outperform all of the state-of-the-art local and global models on the popular benchmarks by improving about 0.5\% on micro average accuracy for AIDA test-b with Yago candidate set. The evaluation setup of the training data and candidate set are the same as our baselines for fair comparison.
Code (0)
등록된 구현이 없습니다.
Tasks
Entity DisambiguationLanguage ModelingLanguage ModellingSimilar Papers 제목 키워드 기반
KARL-Trans-NER: Knowledge Aware Representation Learning for Named Entity Recognition using Transformers
The inception of modeling contextual information using models such as BERT, ELMo, and Flair has significantly improved representation learning for words. It has also given SOTA results in almost every NLP task - Machine …
Machine Translationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+5Improving Chemical Named Entity Recognition in Patents with Contextualized Word Embeddings
Chemical patents are an important resource for chemical information. However, few chemical Named Entity Recognition (NER) systems have been evaluated on patent documents, due in part to their structural and linguistic co…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1In-domain Context-aware Token Embeddings Improve Biomedical Named Entity Recognition
Rapidly expanding volume of publications in the biomedical domain makes it increasingly difficult for a timely evaluation of the latest literature. That, along with a push for automated evaluation of clinical reports, pr…
Language ModelingLanguage Modellingnamed-entity-recognitionNamed Entity Recognition+5Clinical Concept Linking with Contextualized Neural Representations
In traditional approaches to entity linking, linking decisions are based on three sources of information {--} the similarity of the mention string to an entity{'}s name, the similarity of the context of the document to t…
Entity LinkingAssessing Demographic Bias in Named Entity Recognition
Named Entity Recognition (NER) is often the first step towards automated Knowledge Base (KB) generation from raw text. In this work, we assess the bias in various Named Entity Recognition (NER) systems for English across…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER