Dual Latent Variable Model for Low-Resource Natural Language Generation in Dialogue Systems
Recent deep learning models have shown improving results to natural language generation (NLG) irrespective of providing sufficient annotated data. However, a modest training data may harm such models performance. Thus, how to build a generator that can utilize as much of knowledge from a low-resource setting data is a crucial issue in NLG. This paper presents a variational neural-based generation model to tackle the NLG problem of having limited labeled dataset, in which we integrate a variational inference into an encoder-decoder generator and introduce a novel auxiliary autoencoding with an effective training procedure. Experiments showed that the proposed methods not only outperform the previous models when having sufficient training dataset but also show strong ability to work acceptably well when the training data is scarce.
Code (0)
등록된 구현이 없습니다.
Tasks
DecoderText GenerationVariational InferenceSimilar Papers 제목 키워드 기반
Zero-shot Cross-lingual Dialogue Systems with Transferable Latent Variables
Despite the surging demands for multilingual task-oriented dialog systems (e.g., Alexa, Google Home), there has been less research done in multilingual or cross-lingual scenarios. Hence, we propose a zero-shot adaptation…
Intent DetectionNatural Language Understandingslot-fillingSlot FillingPiecewise Latent Variables for Neural Variational Text Processing
Advances in neural variational inference have facilitated the learning of powerful directed graphical models with continuous latent variables, such as variational autoencoders. The hope is that such models will learn to …
Text GenerationVariational InferenceDiscrete Latent Variable Representations for Low-Resource Text Classification
While much work on deep latent variable models of text uses continuous latent variables, discrete latent variables are interesting because they are more interpretable and typically more space efficient. We consider sever…
ClassificationGeneral ClassificationSentenceSentence Classification+2Automatic Validation of Textual Attribute Values in E-commerce Catalog by Learning with Limited Labeled Data
Product catalogs are valuable resources for eCommerce website. In the catalog, a product is associated with multiple attributes whose values are short texts, such as product name, brand, functionality and flavor. Usually…
AttributeFew-Shot LearningMeta-LearningNatural Language InferenceTensor Decomposition for Fast Parsing with Latent-Variable PCFGs
We describe an approach to speed-up inference with latent variable PCFGs, which have been shown to be highly effective for natural language parsing. Our approach is based on a tensor formulation recently introduced for …
Tensor Decomposition