Improving Text to Image Generation using Mode-seeking Function
Generative Adversarial Networks (GANs) have long been used to understand the semantic relationship between the text and image. However, there are problems with mode collapsing in the image generation that causes some preferred output modes. Our aim is to improve the training of the network by using a specialized mode-seeking loss function to avoid this issue. In the text to image synthesis, our loss function differentiates two points in latent space for the generation of distinct images. We validate our model on the Caltech Birds (CUB) dataset and the Microsoft COCO dataset by changing the intensity of the loss function during the training. Experimental results demonstrate that our model works very well compared to some state-of-the-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Image GenerationText to Image GenerationText-to-Image GenerationSimilar Papers 제목 키워드 기반
One-step Diffusion Models with $f$-Divergence Distribution Matching
Sampling from diffusion models involves a slow iterative process that hinders their practical deployment, especially for interactive applications. To accelerate generation speed, recent approaches distill a multi-step di…
Image GenerationText to Image GenerationText-to-Image GenerationZero-Shot Text-to-Image GenerationText-to-3D Generation using Jensen-Shannon Score Distillation
Score distillation sampling is an effective technique to generate 3D models from text prompts, utilizing pre-trained large-scale text-to-image diffusion models as guidance. However, the produced 3D assets tend to be over…
3D GenerationText to 3DInvestigating Table-to-Text Generation Capabilities of LLMs in Real-World Information Seeking Scenarios
Tabular data is prevalent across various industries, necessitating significant time and effort for users to understand and manipulate for their information-seeking purposes. The advancements in large language models (LLM…
Table-to-Text GenerationText GenerationECIS-VQG: Generation of Entity-centric Information-seeking Questions from Videos
Previous studies on question generation from videos have mostly focused on generating questions about common objects and attributes and hence are not entity-centric. In this work, we focus on the generation of entity-cen…
Fact CheckingQuestion GenerationQuestion-GenerationMode Seeking Generative Adversarial Networks for Diverse Image Synthesis
Most conditional generation tasks expect diverse outputs given a single conditional context. However, conditional generative adversarial networks (cGANs) often focus on the prior conditional information and ignore the in…
DiversityImage GenerationImage-to-Image TranslationMultimodal Unsupervised Image-To-Image Translation+1