Label-guided Data Augmentation for Prompt-based Few Shot Learners
Recent advances on large pre-trained language models (PLMs) lead impressive gains on many natural language understanding (NLU) tasks with task-specific fine-tuning. However, direct fine-tuning PLMs heavily rely on large amount of labeled instances, which are expensive and time-consuming to obtain. Prompt-based tuning on PLMs has proven valuable for few shot tasks. Existing works studying prompt-based tuning for few-shot NLU mainly focus on deriving proper label words with a verbalizer or generating prompt templates for eliciting semantics from PLMs. In addition, conventional data augmentation methods can enrich training data for improving few-shot learning, while ignoring the label semantics. It is promising to leverage the rich label semantics in label words for data augmentation to facilitate prompt-based tuning for the downstream NLU tasks. However, the work on this is rather limited. Therefore, we study a new problem of data augmentation for prompt-based few shot learners. We propose a novel label-guided data augmentation method PromptDA which exploits the enriched label semantic information for data augmentation. Experimental results on several few shot text classification tasks show that our proposed framework achieves superior performance by effectively leveraging label semantics and data augmentation in language understanding.
Code (0)
등록된 구현이 없습니다.
Tasks
Data AugmentationFew-Shot LearningFew-Shot Text ClassificationNatural Language Understandingtext-classificationText ClassificationSimilar Papers 제목 키워드 기반
PromptDA: Label-guided Data Augmentation for Prompt-based Few-shot Learners
Recent advances in large pre-trained language models (PLMs) lead to impressive gains in natural language understanding (NLU) tasks with task-specific fine-tuning. However, directly fine-tuning PLMs heavily relies on suff…
Data AugmentationFew-Shot LearningFew-Shot Text ClassificationNatural Language Understanding+2LM-CPPF: Paraphrasing-Guided Data Augmentation for Contrastive Prompt-Based Few-Shot Fine-Tuning
In recent years, there has been significant progress in developing pre-trained language models for NLP. However, these models often struggle when fine-tuned on small datasets. To address this issue, researchers have prop…
Contrastive LearningData AugmentationLinguistic AcceptabilityNatural Language Inference+3PromptMix: A Class Boundary Augmentation Method for Large Language Model Distillation
Data augmentation is a widely used technique to address the problem of text classification when there is a limited amount of training data. Recent work often tackles this problem using large language models (LLMs) like G…
Data AugmentationLanguage ModelingLanguage ModellingLarge Language Model+2Prompt-guided Scene Generation for 3D Zero-Shot Learning
Zero-shot learning on 3D point cloud data is a related underexplored problem compared to its 2D image counterpart. 3D data brings new challenges for ZSL due to the unavailability of robust pre-trained feature extraction …
Contrastive LearningData AugmentationScene GenerationZero-Shot LearningTarget-driven One-Shot Unsupervised Domain Adaptation
In this paper, we introduce a novel framework for the challenging problem of One-Shot Unsupervised Domain Adaptation (OSUDA), which aims to adapt to a target domain with only a single unlabeled target sample. Unlike exis…
Domain AdaptationOne-shot Unsupervised Domain AdaptationUnsupervised Domain Adaptation