An Experimental Study on Data Augmentation Techniques for Named Entity Recognition on Low-Resource Domains
Named Entity Recognition (NER) is a machine learning task that traditionally relies on supervised learning and annotated data. Acquiring such data is often a challenge, particularly in specialized fields like medical, legal, and financial sectors. Those are commonly referred to as low-resource domains, which comprise long-tail entities, due to the scarcity of available data. To address this, data augmentation techniques are increasingly being employed to generate additional training instances from the original dataset. In this study, we evaluate the effectiveness of two prominent text augmentation techniques, Mention Replacement and Contextual Word Replacement, on two widely-used NER models, Bi-LSTM+CRF and BERT. We conduct experiments on four datasets from low-resource domains, and we explore the impact of various combinations of training subset sizes and number of augmented examples. We not only confirm that data augmentation is particularly beneficial for smaller datasets, but we also demonstrate that there is no universally optimal number of augmented examples, i.e., NER practitioners must experiment with different quantities in order to fine-tune their projects.
Code (0)
등록된 구현이 없습니다.
Tasks
Data Augmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NERText AugmentationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Data Augmentation for Cross-Domain Named Entity Recognition
Current work in named entity recognition (NER) shows that data augmentation techniques can produce more robust models. However, most existing techniques focus on augmenting in-domain data in low-resource scenarios where …
Cross-Domain Named Entity RecognitionData Augmentationnamed-entity-recognitionNamed Entity Recognition+2GDA: Generative Data Augmentation Techniques for Relation Extraction Tasks
Relation extraction (RE) tasks show promising performance in extracting relations from two entities mentioned in sentences, given sufficient annotations available during training. Such annotations would be labor-intensiv…
Data AugmentationRelationRelation ExtractionEntity-to-Text based Data Augmentation for various Named Entity Recognition Tasks
Data augmentation techniques have been used to alleviate the problem of scarce labeled data in various NER tasks (flat, nested, and discontinuous NER tasks). Existing augmentation techniques either manipulate the words i…
Data AugmentationDiversitynamed-entity-recognitionNamed Entity Recognition+3An Analysis of Simple Data Augmentation for Named Entity Recognition
Simple yet effective data augmentation techniques have been proposed for sentence-level and sentence-pair natural language processing tasks. Inspired by these efforts, we design and compare data augmentation for named en…
Data Augmentationnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+1Robust Self-Augmentation for Named Entity Recognition with Meta Reweighting
Self-augmentation has received increasing research interest recently to improve named entity recognition (NER) performance in low-resource scenarios. Token substitution and mixup are two feasible heterogeneous self-augme…
named-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)NER