Named Entity Recognition in Multi-level Contexts
Named entity recognition is a critical task in the natural language processing field. Most existing methods for this task can only exploit contextual information within a sentence. However, their performance on recognizing entities in limited or ambiguous sentence-level contexts is usually unsatisfactory. Fortunately, other sentences in the same document can provide supplementary document-level contexts to help recognize these entities. In addition, words themselves contain word-level contextual information since they usually have different preferences of entity type and relative position from named entities. In this paper, we propose a unified framework to incorporate multi-level contexts for named entity recognition. We use TagLM as our basic model to capture sentence-level contexts. To incorporate document-level contexts, we propose to capture interactions between sentences via a multi-head self attention network. To mine word-level contexts, we propose an auxiliary task to predict the type of each word to capture its type preference. We jointly train our model in entity recognition and the auxiliary classification task via multi-task learning. The experimental results on several benchmark datasets validate the effectiveness of our method.
Code (0)
등록된 구현이 없습니다.
Tasks
Multi-Task Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)SentenceSimilar Papers 제목 키워드 기반
DAMO-NLP at SemEval-2022 Task 11: A Knowledge-based System for Multilingual Named Entity Recognition
The MultiCoNER shared task aims at detecting semantically ambiguous and complex named entities in short and low-context settings for multiple languages. The lack of contexts makes the recognition of ambiguous named entit…
Multilingual Named Entity RecognitionNamed Entity RecognitionNamed Entity Recognition (NER)SentenceExplicitly Capturing Relations between Entity Mentions via Graph Neural Networks for Domain-specific Named Entity Recognition
Named entity recognition (NER) is well studied for the general domain, and recent systems have achieved human-level performance for identifying common entity types. However, the NER performance is still moderate for spec…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERImproving Named Entity Recognition by External Context Retrieving and Cooperative Learning
Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we …
Chinese Named Entity RecognitionChunkingNamed Entity RecognitionNamed Entity Recognition (NER)+2Aiding Intra-Text Representations with Visual Context for Multimodal Named Entity Recognition
With massive explosion of social media such as Twitter and Instagram, people daily share billions of multimedia posts, containing images and text. Typically, text in these posts is short, informal and noisy, leading to a…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)Named Entity Recognition on Code-Switched Data Using Conditional Random Fields
Named Entity Recognition is an important information extraction task that identifies proper names in unstructured texts and classifies them into some pre-defined categories. Identification of named entities in code-mixed…
Language Identificationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)