Single Example Can Improve Zero-Shot Data Generation
Sub-tasks of intent classification, such as robustness to distribution shift, adaptation to specific user groups and personalization, out-of-domain detection, require extensive and flexible datasets for experiments and evaluation. As collecting such datasets is time- and labor-consuming, we propose to use text generation methods to gather datasets. The generator should be trained to generate utterances that belong to the given intent. We explore two approaches to the generation of task-oriented utterances: in the zero-shot approach, the model is trained to generate utterances from seen intents and is further used to generate utterances for intents unseen during training. In the one-shot approach, the model is presented with a single utterance from a test intent. We perform a thorough automatic, and human evaluation of the intrinsic properties of two-generation approaches. The attributes of the generated data are close to original test sets, collected via crowd-sourcing.
Code (0)
등록된 구현이 없습니다.
Tasks
intent-classificationIntent ClassificationText GenerationSimilar Papers 제목 키워드 기반
Large Language Models are Zero-Shot Reasoners
Pretrained large language models (LLMs) are widely used in many sub-fields of natural language processing (NLP) and generally known as excellent few-shot learners with task-specific exemplars. Notably, chain of thought (…
Arithmetic ReasoningCommon Sense ReasoningDate UnderstandingFew-Shot Learning+3Many-Shot In-Context Learning in Multimodal Foundation Models
Large language models are effective at few-shot in-context learning (ICL). Recent advancements in multimodal foundation models have enabled unprecedentedly long context windows, presenting an opportunity to explore their…
image-classificationImage ClassificationIn-Context LearningObject LocalizationNot the Example, but the Process: How Self-Generated Examples Enhance LLM Reasoning
Recent studies have shown that Large Language Models (LLMs) can improve their reasoning performance through self-generated few-shot examples, achieving results comparable to manually curated in-context examples. However,…
SDM-Net: A Simple and Effective Model for Generalized Zero-Shot Learning
Zero-Shot Learning (ZSL) is a classification task where we do not have even a single training labeled example from a set of unseen classes. Instead, we only have prior information (or description) about seen and unseen c…
DescriptiveGeneral ClassificationGeneralized Zero-Shot LearningSemantic Similarity+2On the Zero-shot Adversarial Robustness of Vision-Language Models: A Truly Zero-shot and Training-free Approach
Pre-trained Vision-Language Models (VLMs) like CLIP, have demonstrated strong zero-shot generalization capabilities. Despite their effectiveness on various downstream tasks, they remain vulnerable to adversarial samp…
Adversarial RobustnessZero-shot Generalization