paper-with-me

Papers

DuDGAN: Improving Class-Conditional GANs via Dual-Diffusion

2023-05-24 · Taesun Yeom, Minhyeok Lee

Class-conditional image generation using generative adversarial networks (GANs) has been investigated through various techniques; however, it continues to face challenges such as mode collapse, training instability, and low-quality output in cases of datasets with high intra-class variation. Furthermore, most GANs often converge in larger iterations, resulting in poor iteration efficacy in training procedures. While Diffusion-GAN has shown potential in generating realistic samples, it has a critical limitation in generating class-conditional samples. To overcome these limitations, we propose a novel approach for class-conditional image generation using GANs called DuDGAN, which incorporates a dual diffusion-based noise injection process. Our method consists of three unique networks: a discriminator, a generator, and a classifier. During the training process, Gaussian-mixture noises are injected into the two noise-aware networks, the discriminator and the classifier, in distinct ways. This noisy data helps to prevent overfitting by gradually introducing more challenging tasks, leading to improved model performance. As a result, our method outperforms state-of-the-art conditional GAN models for image generation in terms of performance. We evaluated our method using the AFHQ, Food-101, and CIFAR-10 datasets and observed superior results across metrics such as FID, KID, Precision, and Recall score compared with comparison models, highlighting the effectiveness of our approach.

📄 PDF Abstract BibTeX arXiv:2305.14849

Code (0)

등록된 구현이 없습니다.

Tasks

Conditional Image GenerationImage Generation

Similar Papers 제목 키워드 기반

Turning Waste into Wealth: Leveraging Low-Quality Samples for Enhancing Continuous Conditional Generative Adversarial Networks

2023-08-20 · Xin Ding, Yongwei Wang, Zuheng Xu

Continuous Conditional Generative Adversarial Networks (CcGANs) enable generative modeling conditional on continuous scalar variables (termed regression labels). However, they can produce subpar fake images due to limite…

Data Augmentation

SRNDiff: Short-term Rainfall Nowcasting with Condition Diffusion Model

2024-02-21 · XuDong Ling, Chaorong Li, Fengqing Qin, Peng Yang 외

Diffusion models are widely used in image generation because they can generate high-quality and realistic samples. This is in contrast to generative adversarial networks (GANs) and variational autoencoders (VAEs), which …

DecoderDenoisingImage GenerationPrecipitation Forecasting+1

Learning the conditional law: signatures and conditional GANs in filtering and prediction of diffusion processes

2022-04-01 · Fabian Germ, Marc Sabate-Vidales

We consider the filtering and prediction problem for a diffusion process. The signal and observation are modeled by stochastic differential equations (SDEs) driven by correlated Wiener processes. In classical estimation …

Collapse by Conditioning: Training Class-conditional GANs with Limited Data

2022-01-17 · ICLR 2022 4 · Mohamad Shahbazi, Martin Danelljan, Danda Pani Paudel, Luc van Gool

Class-conditioning offers a direct means to control a Generative Adversarial Network (GAN) based on a discrete input variable. While necessary in many applications, the additional information provided by the class labels…

Generative Adversarial Network

Efficient Spatially Sparse Inference for Conditional GANs and Diffusion Models

2022-11-03 · Muyang Li, Ji Lin, Chenlin Meng, Stefano Ermon 외

During image editing, existing deep generative models tend to re-synthesize the entire output from scratch, including the unedited regions. This leads to a significant waste of computation, especially for minor editing o…

GPU