paper-with-me

홈 › Papers

Improving Named Entity Recognition by External Context Retrieving and Cooperative Learning

2021-05-08 · ACL 2021 5 · Xinyu Wang, Yong Jiang, Nguyen Bach, Tao Wang, Zhongqiang Huang, Fei Huang, Kewei Tu

Recent advances in Named Entity Recognition (NER) show that document-level contexts can significantly improve model performance. In many application scenarios, however, such contexts are not available. In this paper, we propose to find external contexts of a sentence by retrieving and selecting a set of semantically relevant texts through a search engine, with the original sentence as the query. We find empirically that the contextual representations computed on the retrieval-based input view, constructed through the concatenation of a sentence and its external contexts, can achieve significantly improved performance compared to the original input view based only on the sentence. Furthermore, we can improve the model performance of both input views by Cooperative Learning, a training method that encourages the two input views to produce similar contextual representations or output label distributions. Experiments show that our approach can achieve new state-of-the-art performance on 8 NER data sets across 5 domains.

📄 PDF Abstract BibTeX arXiv:2105.03654

Code (3)

modelscope/AdaSeq/tree/master/examples/RaNER 공식 구현 pytorch
modelscope/adaseq 공식 구현 pytorch
Alibaba-NLP/CLNER pytorch

Tasks

Chinese Named Entity RecognitionChunkingNamed Entity RecognitionNamed Entity Recognition (NER)RetrievalSentence

Methods 이 논문이 사용한 방법론

Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Residual Connection 설명 없음
Weight Decay 설명 없음
Attention Dropout Attention Dropout is a type of dropout used in attention-based architectures, where elements are randomly dropped out of the…
Linear Warmup With Linear Decay Linear Warmup With Linear Decay is a learning rate schedule in which we increase the learning rate linearly for $n$ updates and then linearly decay afterwards.
WordPiece 설명 없음
Adam 설명 없음
Dropout Dropout is a regularization technique for neural networks that drops a unit (along with connections) at training time with a specified probability $p$ (a common value is…

Similar Papers 제목 키워드 기반

GlobalNER: Incorporating Non-local Information into Named Entity Recognition

2023-03-06 · Chiao-Wei Hsu, Keh-Yih Su

Nowadays, many Natural Language Processing (NLP) tasks see the demand for incorporating knowledge external to the local information to further improve the performance. However, there is little related work on Named Entit…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1

The Role of Global and Local Context in Named Entity Recognition

2023-05-04 · Arthur Amalvy, Vincent Labatut, Richard Dufour

Pre-trained transformer-based models have recently shown great performance when applied to Named Entity Recognition (NER). As the complexity of their self-attention mechanism prevents them from processing long documents …

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER

Combining neural and knowledge-based approaches to Named Entity Recognition in Polish

2018-11-26 · Sławomir Dadas

Named entity recognition (NER) is one of the tasks in natural language processing that can greatly benefit from the use of external knowledge sources. We propose a named entity recognition framework composed of knowledge…

Entity Linkingnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2

Named Entity Recognition in Context

2025-03-26 · Colin Brisson, Ayoub Kahfy, Marc Bui, Frédéric Constant

We present the Named Entity Recognition system developed by the Edit Dunhuang team for the EvaHan2025 competition. Our approach integrates three core components: (1) Pindola, a modern transformer-based bidirectional enco…

Entity Disambiguationnamed-entity-recognitionNamed Entity RecognitionRetrieval

PAI at SemEval-2023 Task 2: A Universal System for Named Entity Recognition with External Entity Information

2023-05-10 · Long Ma, Kai Lu, Tianbo Che, Hailong Huang 외

The MultiCoNER II task aims to detect complex, ambiguous, and fine-grained named entities in low-context situations and noisy scenarios like the presence of spelling mistakes and typos for multiple languages. The task po…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+2