LLM-DA: Data Augmentation via Large Language Models for Few-Shot Named Entity Recognition
Despite the impressive capabilities of large language models (LLMs), their performance on information extraction tasks is still not entirely satisfactory. However, their remarkable rewriting capabilities and extensive world knowledge offer valuable insights to improve these tasks. In this paper, we propose $LLM-DA$, a novel data augmentation technique based on LLMs for the few-shot NER task. To overcome the limitations of existing data augmentation methods that compromise semantic integrity and address the uncertainty inherent in LLM-generated text, we leverage the distinctive characteristics of the NER task by augmenting the original data at both the contextual and entity levels. Our approach involves employing 14 contextual rewriting strategies, designing entity replacements of the same type, and incorporating noise injection to enhance robustness. Extensive experiments demonstrate the effectiveness of our approach in enhancing NER model performance with limited data. Furthermore, additional analyses provide further evidence supporting the assertion that the quality of the data we generate surpasses that of other existing methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Data Augmentationfew-shot-nerFew-shot NERnamed-entity-recognitionNamed Entity RecognitionNERWorld KnowledgeSimilar Papers 제목 키워드 기반
Enhancing NER Performance in Low-Resource Pakistani Languages using Cross-Lingual Data Augmentation
Named Entity Recognition (NER), a fundamental task in Natural Language Processing (NLP), has shown significant advancements for high-resource languages. However, due to a lack of annotated datasets and limited representa…
Data AugmentationFew-Shot Learningnamed-entity-recognitionNamed Entity Recognition+2AugGPT: Leveraging ChatGPT for Text Data Augmentation
Text data augmentation is an effective strategy for overcoming the challenge of limited sample sizes in many natural language processing (NLP) tasks. This challenge is especially prominent in the few-shot learning scenar…
Data AugmentationFew-Shot LearningSentencetext-classification+1Entailment as Few-Shot Learner
Large pre-trained language models (LMs) have demonstrated remarkable ability as few-shot learners. However, their success hinges largely on scaling model parameters to a degree that makes it challenging to train and serv…
Contrastive LearningData AugmentationFew-Shot LearningLinguistic Acceptability+7Empirical Study of Zero-Shot NER with ChatGPT
Large language models (LLMs) exhibited powerful capability in various natural language processing tasks. This work focuses on exploring LLM performance on zero-shot information extraction, with a focus on the ChatGPT and…
Arithmetic Reasoningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2Label-guided Data Augmentation for Prompt-based Few Shot Learners
Recent advances on large pre-trained language models (PLMs) lead impressive gains on many natural language understanding (NLU) tasks with task-specific fine-tuning. However, direct fine-tuning PLMs heavily rely on large …
Data AugmentationFew-Shot LearningFew-Shot Text ClassificationNatural Language Understanding+2