Composed Variational Natural Language Generation for Few-shot Intents
In this paper, we focus on generating training examples for few-shot intents in the realistic imbalanced scenario. To build connections between existing many-shot intents and few-shot intents, we consider an intent as a combination of a domain and an action, and propose a composed variational natural language generator (CLANG), a transformer-based conditional variational autoencoder. CLANG utilizes two latent variables to represent the utterances corresponding to two different independent parts (domain and action) in the intent, and the latent variables are composed together to generate natural examples. Additionally, to improve the generator learning, we adopt the contrastive regularization loss that contrasts the in-class with the out-of-class utterance generation given the intent. To evaluate the quality of the generated utterances, experiments are conducted on the generalized few-shot intent detection task. Empirical results show that our proposed model achieves state-of-the-art performances on two real-world intent detection datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Intent DetectionText GenerationSimilar Papers 제목 키워드 기반
Graph-DPEP: Decomposed Plug and Ensemble Play for Few-Shot Document Relation Extraction with Graph-of-Thoughts Reasoning
Large language models (LLMs) pre-trained on massive corpora have demonstrated impressive few-shot learning capability on many NLP tasks. Recasting an NLP task into a text-to-text generation task is a common practice so t…
Document-level Relation ExtractionFew-Shot LearningRelationRelation Extraction+2Probabilistic Graph Reasoning for Natural Proof Generation
In this paper, we investigate the problem of reasoning over natural language statements. Prior neural based approaches do not explicitly consider the inter-dependency among answers and their proofs. In this paper, we pro…
Variational Autoencoder with Disentanglement Priors for Low-Resource Task-Specific Natural Language Generation
In this paper, we propose a variational autoencoder with disentanglement priors, VAE-DPRIOR, for task-specific natural language generation with none or a handful of task-specific labeled examples. In order to tackle comp…
Data AugmentationDisentanglementFew-Shot LearningRepresentation Learning+3CG-BERT: Conditional Text Generation with BERT for Generalized Few-shot Intent Detection
In this paper, we formulate a more realistic and difficult problem setup for the intent detection task in natural language understanding, namely Generalized Few-Shot Intent Detection (GFSID). GFSID aims to discriminate a…
Conditional Text GenerationIntent DetectionLanguage ModelingLanguage Modelling+3Learning from Language Description: Low-shot Named Entity Recognition via Decomposed Framework
In this work, we study the problem of named entity recognition (NER) in a low resource scenario, focusing on few-shot and zero-shot settings. Built upon large-scale pre-trained language models, we propose a novel NER fra…
Few-Shot Learningnamed-entity-recognitionNamed Entity RecognitionNamed Entity Recognition (NER)+2