PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners
Recent advances in large pre-trained language models (PLMs) lead to impressive gains in natural language understanding (NLU) tasks with task-specific fine-tuning. However, directly fine-tuning PLMs heavily relies on sufficient labeled training instances, which are usually hard to obtain. Prompt-based tuning on PLMs has shown to be powerful for various downstream few-shot tasks. Existing works studying prompt-based tuning for few-shot NLU tasks mainly focus on deriving proper label words with a verbalizer or generating prompt templates to elicit semantics from PLMs. In addition, conventional data augmentation strategies such as synonym substitution, though widely adopted in low-resource scenarios, only bring marginal improvements for prompt-based few-shot learning. Thus, an important research question arises: how to design effective data augmentation methods for prompt-based few-shot tuning? To this end, considering the label semantics are essential in prompt-based tuning, we propose a novel label-guided data augmentation framework PromptDA, which exploits the enriched label semantic information for data augmentation. Extensive experiment results on few-shot text classification tasks demonstrate the superior performance of the proposed framework by effectively leveraging label semantics and data augmentation for natural language understanding. Our code is available at https://github.com/canyuchen/PromptDA.
Code (1)
Tasks
Data AugmentationFew-Shot LearningFew-Shot Text ClassificationNatural Language Understandingtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
Label-guided Data Augmentation for Prompt-based Few Shot Learners
Recent advances on large pre-trained language models (PLMs) lead impressive gains on many natural language understanding (NLU) tasks with task-specific fine-tuning. However, direct fine-tuning PLMs heavily rely on large …
Data AugmentationFew-Shot LearningFew-Shot Text ClassificationNatural Language Understanding+2Bolster Hallucination Detection via Prompt-Guided Data Augmentation
Large language models (LLMs) have garnered significant interest in AI community. Despite their impressive generation capabilities, they have been found to produce misleading or fabricated information, a phenomenon known …
Data AugmentationLM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning
In recent years, there has been significant progress in developing pre-trained language models for NLP. However, these models often struggle when fine-tuned on small datasets. To address this issue, researchers have prop…
Contrastive LearningData AugmentationLinguistic AcceptabilityNatural Language Inference+3LLM-Guided Synthetic Augmentation (LGSA) for Mitigating Bias in AI Systems
Bias in AI systems, especially those relying on natural language data, raises ethical and practical concerns. Underrepresentation of certain groups often leads to uneven performance across demographics. Traditional fairn…
Binary ClassificationSemantic SimilarityRoPDA: Robust Prompt-based Data Augmentation for Low-Resource Named Entity Recognition
Data augmentation has been widely used in low-resource NER tasks to tackle the problem of data sparsity. However, previous data augmentation methods have the disadvantages of disrupted syntactic structures, token-label m…
Data AugmentationLow Resource Named Entity Recognitionnamed-entity-recognitionNamed Entity Recognition+1