Adversarial Text to Continuous Image Generation
Existing GAN-based text-to-image models treat images as 2D pixel arrays. In this paper we approach the text-to-image task from a different perspective where a 2D image is represented as an implicit neural representation (INR). We show that straightforward conditioning of the unconditional INR-based GAN method on text inputs is not enough to achieve good performance. We propose a word-level attention-based weight modulation operator that controls the generation process of INR-GAN based on hypernetworks. Our experiments on benchmark datasets show that HyperCGAN achieves competitive performance to existing pixel-based methods and retains the properties of continuous generative models.
Code (0)
등록된 구현이 없습니다.
Tasks
Adversarial TextImage GenerationSimilar Papers 제목 키워드 기반
Continuous Adversarial Flow Models
We propose continuous adversarial flow models, a type of continuous-time flow model trained with an adversarial objective. Unlike flow matching, which uses a fixed mean-squared-error criterion, our approach introduces a …
Text-to-Image GenerationA survey on text generation using generative adversarial networks
This work presents a thorough review concerning recent studies and text generation advancements using Generative Adversarial Networks. The usage of adversarial learning for text generation is promising as it provides alt…
Adversarial TextSurveyText GenerationHyperCGAN: Text-to-Image Synthesis with HyperNet-Modulated Conditional Generative Adversarial Networks
We present HyperCGAN: a conceptually simple and general approach for text-to-image synthesis that uses hypernetworks to condition a GAN model on text. In our setting, the generator and the discriminator weights are contr…
Image GenerationT3: Tree-Autoencoder Constrained Adversarial Text Generation for Targeted Attack
Adversarial attacks against natural language processing systems, which perform seemingly innocuous modifications to inputs, can induce arbitrary mistakes to the target models. Though raised great concerns, such adversari…
Adversarial AttackAdversarial TextDecoderQuestion Answering+3Safeguarding Text-to-Image Generation via Inference-Time Prompt-Noise Optimization
Text-to-Image (T2I) diffusion models are widely recognized for their ability to generate high-quality and diverse images based on text prompts. However, despite recent advances, these models are still prone to generating…
Image GenerationText to Image GenerationText-to-Image Generation