GenCNER: A Generative Framework for Continual Named Entity Recognition
Traditional named entity recognition (NER) aims to identify text mentions into pre-defined entity types. Continual Named Entity Recognition (CNER) is introduced since entity categories are continuously increasing in various real-world scenarios. However, existing continual learning (CL) methods for NER face challenges of catastrophic forgetting and semantic shift of non-entity type. In this paper, we propose GenCNER, a simple but effective Generative framework for CNER to mitigate the above drawbacks. Specifically, we skillfully convert the CNER task into sustained entity triplet sequence generation problem and utilize a powerful pre-trained seq2seq model to solve it. Additionally, we design a type-specific confidence-based pseudo labeling strategy along with knowledge distillation (KD) to preserve learned knowledge and alleviate the impact of label noise at the triplet level. Experimental results on two benchmark datasets show that our framework outperforms previous state-of-the-art methods in multiple CNER settings, and achieves the smallest gap compared with non-CL results.
Code (0)
등록된 구현이 없습니다.
Tasks
Knowledge DistillationContinual LearningSimilar Papers 제목 키워드 기반
Sparse Named Entity Classification using Factorization Machines
Named entity classification is the task of classifying text-based elements into various categories, including places, names, dates, times, and monetary values. A bottleneck in named entity classification, however, is the…
ClassificationGeneral ClassificationDistilling Causal Effect from Miscellaneous Other-Class for Continual Named Entity Recognition
Continual Learning for Named Entity Recognition (CL-NER) aims to learn a growing number of entity types over time from a stream of data. However, simply learning Other-Class in the same way as new entity types amplifies …
Causal InferenceContinual LearningContinual Named Entity RecognitionFG-1-PG-1+5Learn and Review: Enhancing Continual Named Entity Recognition via Reviewing Synthetic Samples
Traditional methods for named entity recognition (NER) classify mentions into a fixed set of pre-defined entity types. However, in many real-world scenarios, new entity types are incrementally involved. To investigate th…
Continual LearningContinual Named Entity Recognitionnamed-entity-recognitionNamed Entity Recognition+2Continual Named Entity Recognition without Catastrophic Forgetting
Continual Named Entity Recognition (CNER) is a burgeoning area, which involves updating an existing model by incorporating new entity types sequentially. Nevertheless, continual learning approaches are often severely aff…
Continual LearningContinual Named Entity Recognitionnamed-entity-recognitionNamed Entity RecognitionInformed Named Entity Recognition Decoding for Generative Language Models
Ever-larger language models with ever-increasing capabilities are by now well-established text processing tools. Alas, information extraction tasks such as named entity recognition are still largely unaffected by this pr…
named-entity-recognitionNamed Entity RecognitionText Generation