TopicGAN: Unsupervised Text Generation from Explainable Latent Topics
Learning discrete representations of data and then generating data from the discovered representations have been increasingly studied because the obtained discrete representations can benefit unsupervised learning. However, the performance of learning discrete representations of textual data with deep generative models has not been widely explored. In addition, although generative adversarial networks(GAN) have shown impressing results in many areas such as image generation, for text generation, it is notorious for extremely difficult to train. In this work, we propose TopicGAN, a two-step text generative model, which is able to solve those two important problems simultaneously. In the first step, it discovers the latent topics and produced bag-of-words according to the latent topics. In the second step, it generates text from the produced bag-of-words. In our experiments, we show our model can discover meaningful discrete latent topics of texts in an unsupervised fashion and generate high quality natural language from the discovered latent topics.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationText GenerationSimilar Papers 제목 키워드 기반
Generalizable and Explainable Dialogue Generation via Explicit Action Learning
Response generation for task-oriented dialogues implicitly optimizes two objectives at the same time: task completion and language quality. Conditioned response generation serves as an effective approach to separately an…
Dialogue GenerationResponse GenerationSelf-Corrected Image Generation with Explainable Latent Rewards
Despite significant progress in text-to-image generation, aligning outputs with complex prompts remains challenging, particularly for fine-grained semantics and spatial relations. This difficulty stems from the feed-forw…
Text-to-Image GenerationLearning to Predict Explainable Plots for Neural Story Generation
Story generation is an important natural language processing task that aims to generate coherent stories automatically. While the use of neural networks has proven effective in improving story generation, how to learn to…
SentenceStory GenerationINSTRUCTSCORE: Explainable Text Generation Evaluation with Finegrained Feedback
Automatically evaluating the quality of language generation is critical. Although recent learned metrics show high correlation with human judgement, these metrics can not explain their verdict or associate the scores wit…
DiagnosticText GenerationExplainable and Discourse Topic-aware Neural Language Understanding
Marrying topic models and language models exposes language understanding to a broader source of document-level context beyond sentences via topics. While introducing topical semantics in language models, existing approac…
Document ClassificationLanguage ModelingLanguage ModellingRetrieval+4