paper-with-me

홈 › Papers

Conditional Hybrid GAN for Sequence Generation

2020-09-18 · Yi Yu, Abhishek Srivastava, Rajiv Ratn Shah

Conditional sequence generation aims to instruct the generation procedure by conditioning the model with additional context information, which is a self-supervised learning issue (a form of unsupervised learning with supervision information from data itself). Unfortunately, the current state-of-the-art generative models have limitations in sequence generation with multiple attributes. In this paper, we propose a novel conditional hybrid GAN (C-Hybrid-GAN) to solve this issue. Discrete sequence with triplet attributes are separately generated when conditioned on the same context. Most importantly, relational reasoning technique is exploited to model not only the dependency inside each sequence of the attribute during the training of the generator but also the consistency among the sequences of attributes during the training of the discriminator. To avoid the non-differentiability problem in GANs encountered during discrete data generation, we exploit the Gumbel-Softmax technique to approximate the distribution of discrete-valued sequences.Through evaluating the task of generating melody (associated with note, duration, and rest) from lyrics, we demonstrate that the proposed C-Hybrid-GAN outperforms the existing methods in context-conditioned discrete-valued sequence generation.

📄 PDF Abstract BibTeX arXiv:2009.08616

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeRelational ReasoningSelf-Supervised LearningTriplet

Similar Papers 제목 키워드 기반

MUGL: Large Scale Multi Person Conditional Action Generation with Locomotion

2021-10-21 · Shubh Maheshwari, Debtanu Gupta, Ravi Kiran Sarvadevabhatla

We introduce MUGL, a novel deep neural model for large-scale, diverse generation of single and multi-person pose-based action sequences with locomotion. Our controllable approach enables variable-length generations custo…

Action GenerationDiversityHuman action generation

Generating Thematic Chinese Poetry using Conditional Variational Autoencoders with Hybrid Decoders

2017-11-21 · Xiaopeng Yang, Xiaowen Lin, Shunda Suo, Ming Li

Computer poetry generation is our first step towards computer writing. Writing must have a theme. The current approaches of using sequence-to-sequence models with attention often produce non-thematic poems. We present a …

DecoderRhythm

Context-Aware Autoregressive Models for Multi-Conditional Image Generation

2025-05-18 · Yixiao Chen, Zhiyuan Ma, Guoli Jia, Che Jiang 외

Autoregressive transformers have recently shown impressive image generation quality and efficiency on par with state-of-the-art diffusion models. Unlike diffusion architectures, autoregressive models can naturally incorp…

Conditional Image GenerationImage Generation

Infinite Nature: Perpetual View Generation of Natural Scenes from a Single Image

2020-12-17 · ICCV 2021 10 · Andrew Liu, Richard Tucker, Varun Jampani, Ameesh Makadia 외

We introduce the problem of perpetual view generation - long-range generation of novel views corresponding to an arbitrarily long camera trajectory given a single image. This is a challenging problem that goes far beyond…

Image GenerationPerpetual View GenerationVideo Generation

Distribution Matching in Variational Inference

2018-02-19 · Mihaela Rosca, Balaji Lakshminarayanan, Shakir Mohamed

With the increasingly widespread deployment of generative models, there is a mounting need for a deeper understanding of their behaviors and limitations. In this paper, we expose the limitations of Variational Autoencode…

Variational Inference