Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning
Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we propose to find external contexts of a sentence by retrieving and selecting a set of semantically relevant texts through a search engine, with the original sentence as the query. We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved performance compared to the original input view based only on the sentence. Furthermore, we can improve the model performance of both input views by Cooperative Learning, a training method that encourages the two input views to produce similar contextual representations or output label distributions. Experiments show that our approach can achieve new state-of-the-art performance on 8 NER data sets across 5 domains.
Code (3)
Tasks
Chinese Named Entity RecognitionChunkingNamed Entity RecognitionNamed Entity Recognition (NER)RetrievalSentenceMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
GlobalNER: Incorporating Non-local Information into Named Entity Recognition
Nowadays, many Natural Language Processing (NLP) tasks see the demand for incorporating knowledge external to the local information to further improve the performance. However, there is little related work on Named Entit…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1The Role of Global and Local Context in Named Entity Recognition
Pre-trained transformer-based models have recently shown great performance when applied to Named Entity Recognition (NER). As the complexity of their self-attention mechanism prevents them from processing long documents …
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERCombining neural and knowledge-based approaches to Named Entity Recognition in Polish
Named entity recognition (NER) is one of the tasks in natural language processing that can greatly benefit from the use of external knowledge sources. We propose a named entity recognition framework composed of knowledge…
Entity Linkingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2Named Entity Recognition in Context
We present the Named Entity Recognition system developed by the Edit Dunhuang team for the EvaHan2025 competition. Our approach integrates three core components: (1) Pindola, a modern transformer-based bidirectional enco…
Entity Disambiguationnamed-entity-recognitionNamed Entity RecognitionRetrievalPAI at SemEval-2023 Task 2: A Universal System for Named Entity Recognition with External Entity Information
The MultiCoNER II task aims to detect complex, ambiguous, and fine-grained named entities in low-context situations and noisy scenarios like the presence of spelling mistakes and typos for multiple languages. The task po…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2