paper-with-me

홈 › Papers

A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues

2016-05-19 · Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin, Joelle Pineau, Aaron Courville, Yoshua Bengio

Sequential data often possesses a hierarchical structure with complex dependencies between subsequences, such as found between the utterances in a dialogue. In an effort to model this kind of generative process, we propose a neural network-based generative architecture, with latent stochastic variables that span a variable number of time steps. We apply the proposed model to the task of dialogue response generation and compare it with recent neural network architectures. We evaluate the model performance through automatic evaluation metrics and by carrying out a human evaluation. The experiments demonstrate that our model improves upon recently proposed models and that the latent variables facilitate the generation of long outputs and maintain the context.

📄 PDF Abstract BibTeX arXiv:1605.06069

Code (9)

Tanasho0928/chat-oriented pytorch
Tanasho0928/ncm pytorch
WolfNiu/AdversarialDialogue tf
ctr4si/A-Hierarchical-Latent-Structure-for-Variational-Conversation-Modeling pytorch
julianser/hed-dlg-truncated
mike-n-7/ADEM
natashamjaques/neural_chat pytorch
nouhadziri/THRED tf
wayalhruhi/julianser

Tasks

DecoderResponse Generation

Similar Papers 제목 키워드 기반

Dirichlet Latent Variable Hierarchical Recurrent Encoder-Decoder in Dialogue Generation

2019-11-01 · IJCNLP 2019 11 · Min Zeng, Yisen Wang, Yuan Luo

Variational encoder-decoders have achieved well-recognized performance in the dialogue generation task. Existing works simply assume the Gaussian priors of the latent variable, which are incapable of representing complex…

DecoderDialogue GenerationSentence

Variational Composite Autoencoders

2018-04-12 · Jiangchao Yao, Ivor Tsang, Ya zhang

Learning in the latent variable model is challenging in the presence of the complex data structure or the intractable latent variable. Previous variational autoencoders can be low effective due to the straightforward enc…

Decoder

A Hierarchical Latent Structure for Variational Conversation Modeling

2018-04-10 · NAACL 2018 6 · Yookoon Park, Jaemin Cho, Gunhee Kim

Variational autoencoders (VAE) combined with hierarchical RNNs have emerged as a powerful framework for conversation modeling. However, they suffer from the notorious degeneration problem, where the decoders learn to ign…

Towards Generating Long and Coherent Text with Multi-Level Latent Variable Models

2019-02-01 · ACL 2019 7 · Dinghan Shen, Asli Celikyilmaz, Yizhe Zhang, Liqun Chen 외

Variational autoencoders (VAEs) have received much attention recently as an end-to-end architecture for text generation with latent variables. In this paper, we investigate several multi-level structures to learn a VAE m…

DecoderSentenceText Generation

From neural PCA to deep unsupervised learning

2014-11-28 · Harri Valpola

A network supporting deep unsupervised learning is presented. The network is an autoencoder with lateral shortcut connections from the encoder to decoder at each level of the hierarchy. The lateral shortcut connections a…

DecoderDenoising