paper-with-me

홈 › Papers

A Semi-Supervised Stable Variational Network for Promoting Replier-Consistency in Dialogue Generation

2019-11-01 · IJCNLP 2019 11 · Jinxin Chang, Ruifang He, Longbiao Wang, Xiangyu Zhao, Ting Yang, Ruifang Wang

Neural sequence-to-sequence models for dialog systems suffer from the problem of favoring uninformative and non replier-specific responses due to lack of the global and relevant information guidance. The existing methods model the generation process by leveraging the neural variational network with simple Gaussian. However, the sampled information from latent space usually becomes useless due to the KL divergence vanishing issue, and the highly abstractive global variables easily dilute the personal features of replier, leading to a non replier-specific response. Therefore, a novel Semi-Supervised Stable Variational Network (SSVN) is proposed to address these issues. We use a unit hypersperical distribution, namely the von Mises-Fisher (vMF), as the latent space of a semi-supervised model, which can obtain the stable KL performance by setting a fixed variance and hence enhance the global information representation. Meanwhile, an unsupervised extractor is introduced to automatically distill the replier-tailored feature which is then injected into a supervised generator to encourage the replier-consistency. Experimental results on two large conversation datasets show that our model outperforms the competitive baseline models significantly, and can generate diverse and replier-specific responses.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Dialogue Generation

Similar Papers 제목 키워드 기반

Speech enhancement with variational autoencoders and alpha-stable distributions

2019-02-08 · Simon Leglaive, Umut Simsekli, Antoine Liutkus, Laurent Girin 외

This paper focuses on single-channel semi-supervised speech enhancement. We learn a speaker-independent deep generative speech model using the framework of variational autoencoders. The noise model remains unsupervised b…

Speech Enhancement

Properly-weighted graph Laplacian for semi-supervised learning

2018-10-10 · Jeff Calder, Dejan Slepcev

The performance of traditional graph Laplacian methods for semi-supervised learning degrades substantially as the ratio of labeled to unlabeled data decreases, due to a degeneracy in the graph Laplacian. Several approach…

Semi-Supervised Variational Inference over Nonlinear Channels

2023-09-21 · David Burshtein, Eli Bery

Deep learning methods for communications over unknown nonlinear channels have attracted considerable interest recently. In this paper, we consider semi-supervised learning methods, which are based on variational inferenc…

Meta-LearningVariational Inference

Variational Latent-State GPT for Semi-Supervised Task-Oriented Dialog Systems

2021-09-09 · Hong Liu, Yucheng Cai, Zhenru Lin, Zhijian Ou 외

Recently, two approaches, fine-tuning large pre-trained language models and variational training, have attracted significant interests, separately, for semi-supervised end-to-end task-oriented dialog (TOD) systems. In th…

VAE Learning via Stein Variational Gradient Descent

2017-04-18 · NeurIPS 2017 12 · Yunchen Pu, Zhe Gan, Ricardo Henao, Chunyuan Li 외

A new method for learning variational autoencoders (VAEs) is developed, based on Stein variational gradient descent. A key advantage of this approach is that one need not make parametric assumptions about the form of the…