paper-with-me

홈 › Papers

An Experimental Study on Data Augmentation Techniques for Named Entity Recognition on Low-Resource Domains

2024-11-21 · Arthur Elwing Torres, Edleno Silva de Moura, Altigran Soares da Silva, Mario A. Nascimento, Filipe Mesquita

Named Entity Recognition (NER) is a machine learning task that traditionally relies on supervised learning and annotated data. Acquiring such data is often a challenge, particularly in specialized fields like medical, legal, and financial sectors. Those are commonly referred to as low-resource domains, which comprise long-tail entities, due to the scarcity of available data. To address this, data augmentation techniques are increasingly being employed to generate additional training instances from the original dataset. In this study, we evaluate the effectiveness of two prominent text augmentation techniques, Mention Replacement and Contextual Word Replacement, on two widely-used NER models, Bi-LSTM+CRF and BERT. We conduct experiments on four datasets from low-resource domains, and we explore the impact of various combinations of training subset sizes and number of augmented examples. We not only confirm that data augmentation is particularly beneficial for smaller datasets, but we also demonstrate that there is no universally optimal number of augmented examples, i.e., NER practitioners must experiment with different quantities in order to fine-tune their projects.

📄 PDF Abstract BibTeX arXiv:2411.14551

Code (0)

등록된 구현이 없습니다.

Tasks

Data Augmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERText Augmentation

Methods 이 논문이 사용한 방법론

Refunds@Expedia|||How do I get a full refund from Expedia? “How do I get a full refund from Expedia? How do I get a full refund from Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Quick Help &…
Attention 설명 없음
Linear Layer A Linear Layer is a projection $\mathbf{XW + b}$.
Adam 설명 없음
Residual Connection 설명 없음
Weight Decay 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
Multi-Head Attention 설명 없음

Similar Papers 제목 키워드 기반

Data Augmentation for Cross-Domain Named Entity Recognition

2021-09-04 · EMNLP 2021 11 · Shuguang Chen, Gustavo Aguilar, Leonardo Neves, Thamar Solorio

Current work in named entity recognition (NER) shows that data augmentation techniques can produce more robust models. However, most existing techniques focus on augmenting in-domain data in low-resource scenarios where …

Cross-Domain Named Entity RecognitionData Augmentationnamed-entity-recognitionNamed Entity Recognition+2

GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks

2023-05-26 · Xuming Hu, Aiwei Liu, Zeqi Tan, Xin Zhang 외

Relation extraction (RE) tasks show promising performance in extracting relations from two entities mentioned in sentences, given sufficient annotations available during training. Such annotations would be labor-intensiv…

Data AugmentationRelationRelation Extraction

Entity-to-Text based Data Augmentation for various Named Entity Recognition Tasks

2022-10-19 · Xuming Hu, Yong Jiang, Aiwei Liu, Zhongqiang Huang 외

Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks). Existing augmentation techniques either manipulate the words i…

Data AugmentationDiversitynamed-entity-recognitionNamed Entity Recognition+3

An Analysis of Simple Data Augmentation for Named Entity Recognition

2020-10-22 · COLING 2020 8 · Xiang Dai, Heike Adel

Simple yet effective data augmentation techniques have been proposed for sentence-level and sentence-pair natural language processing tasks. Inspired by these efforts, we design and compare data augmentation for named en…

Data Augmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1

Robust Self-Augmentation for Named Entity Recognition with Meta Reweighting

2022-04-25 · NAACL 2022 7 · Linzhi Wu, Pengjun Xie, Jie zhou, Meishan Zhang 외

Self-augmentation has received increasing research interest recently to improve named entity recognition (NER) performance in low-resource scenarios. Token substitution and mixup are two feasible heterogeneous self-augme…

named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER