paper-with-me

Papers

Win-Win Cooperation: Bundling Sequence and Span Models for Named Entity Recognition

2022-07-07 · Bin Ji, Shasha Li, Jie Yu, Jun Ma, Huijun Liu

For Named Entity Recognition (NER), sequence labeling-based and span-based paradigms are quite different. Previous research has demonstrated that the two paradigms have clear complementary advantages, but few models have attempted to leverage these advantages in a single NER model as far as we know. In our previous work, we proposed a paradigm known as Bundling Learning (BL) to address the above problem. The BL paradigm bundles the two NER paradigms, enabling NER models to jointly tune their parameters by weighted summing each paradigm's training loss. However, three critical issues remain unresolved: When does BL work? Why does BL work? Can BL enhance the existing state-of-the-art (SOTA) NER models? To address the first two issues, we implement three NER models, involving a sequence labeling-based model--SeqNER, a span-based NER model--SpanNER, and BL-NER that bundles SeqNER and SpanNER together. We draw two conclusions regarding the two issues based on the experimental results on eleven NER datasets from five domains. We then apply BL to five existing SOTA NER models to investigate the third issue, consisting of three sequence labeling-based models and two span-based models. Experimental results indicate that BL consistently enhances their performance, suggesting that it is possible to construct a new SOTA NER system by incorporating BL into the current SOTA system. Moreover, we find that BL reduces both entity boundary and type prediction errors. In addition, we compare two commonly used labeling tagging methods as well as three types of span semantic representations.

📄 PDF Abstract BibTeX arXiv:2207.03300

Code (0)

등록된 구현이 없습니다.

Tasks

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERType prediction

Similar Papers 제목 키워드 기반

SEPT: Improving Scientific Named Entity Recognition with Span Representation

2019-11-08 · Tan Yan, He-Yan Huang, Xian-Ling Mao

We introduce a new scientific named entity recognizer called SEPT, which stands for Span Extractor with Pre-trained Transformers. In recent papers, span extractors have been demonstrated to be a powerful model compared w…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)

SpanNER: Named Entity Re-/Recognition as Span Prediction

2021-06-01 · ACL 2021 5 · Jinlan Fu, Xuanjing Huang, PengFei Liu

Recent years have seen the paradigm shift of Named Entity Recognition (NER) systems from sequence labeling to span prediction. Despite its preliminary effectiveness, the span prediction model's architectural bias has not…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER+1

Decomposed Meta-Learning for Few-Shot Named Entity Recognition

2022-04-12 · Findings (ACL) 2022 5 · Tingting Ma, Huiqiang Jiang, Qianhui Wu, Tiejun Zhao 외

Few-shot named entity recognition (NER) systems aim at recognizing novel-class named entities based on only a few labeled examples. In this paper, we present a decomposed meta-learning approach which addresses the proble…

Entity TypingFew-shot NERMeta-LearningNamed Entity Recognition+1

A Sequence-to-Set Network for Nested Named Entity Recognition

2021-05-19 · Zeqi Tan, Yongliang Shen, Shuai Zhang, Weiming Lu 외

Named entity recognition (NER) is a widely studied task in natural language processing. Recently, a growing number of studies have focused on the nested NER. The span-based methods, considering the entity recognition as …

Decodernamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2

A Neural Span-Based Continual Named Entity Recognition Model

2023-02-23 · Yunan Zhang, Qingcai Chen

Named Entity Recognition (NER) models capable of Continual Learning (CL) are realistically valuable in areas where entity types continuously increase (e.g., personal assistants). Meanwhile the learning paradigm of NER ad…

Continual LearningContinual Named Entity RecognitionKnowledge Distillationnamed-entity-recognition+3