paper-with-me

Papers

Latent reweighting, an almost free improvement for GANs

2021-10-19 · Thibaut Issenhuth, Ugo Tanielian, David Picard, Jeremie Mary

Standard formulations of GANs, where a continuous function deforms a connected latent space, have been shown to be misspecified when fitting different classes of images. In particular, the generator will necessarily sample some low-quality images in between the classes. Rather than modifying the architecture, a line of works aims at improving the sampling quality from pre-trained generators at the expense of increased computational cost. Building on this, we introduce an additional network to predict latent importance weights and two associated sampling methods to avoid the poorest samples. This idea has several advantages: 1) it provides a way to inject disconnectedness into any GAN architecture, 2) since the rejection happens in the latent space, it avoids going through both the generator and the discriminator, saving computation time, 3) this importance weights formulation provides a principled way to reduce the Wasserstein's distance to the target distribution. We demonstrate the effectiveness of our method on several datasets, both synthetic and high-dimensional.

📄 PDF Abstract BibTeX arXiv:2110.09803

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Diamond in the rough: Improving image realism by traversing the GAN latent space

2021-04-12 · Jeffrey Wen, Fabian Benitez-Quiroz, Qianli Feng, Aleix Martinez

In just a few years, the photo-realism of images synthesized by Generative Adversarial Networks (GANs) has gone from somewhat reasonable to almost perfect largely by increasing the complexity of the networks, e.g., addin…

Style Transfer

Pruning then Reweighting: Towards Data-Efficient Training of Diffusion Models

2024-09-27 · Yize Li, Yihua Zhang, Sijia Liu, Xue Lin

Despite the remarkable generation capabilities of Diffusion Models (DMs), conducting training and inference remains computationally expensive. Previous works have been devoted to accelerating diffusion sampling, but achi…

Image Generation

DCTRGAN: Improving the Precision of Generative Models with Reweighting

2020-09-03 · Sascha Diefenbacher, Engin Eren, Gregor Kasieczka, Anatolii Korol 외

Significant advances in deep learning have led to more widely used and precise neural network-based generative models such as Generative Adversarial Networks (GANs). We introduce a post-hoc correction to deep generative …

FakeCLR: Exploring Contrastive Learning for Solving Latent Discontinuity in Data-Efficient GANs

2022-07-18 · Ziqiang Li, Chaoyue Wang, Heliang Zheng, Jing Zhang 외

Data-Efficient GANs (DE-GANs), which aim to learn generative models with a limited amount of training data, encounter several challenges for generating high-quality samples. Since data augmentation strategies have largel…

Contrastive LearningData AugmentationDiversity

O-GAN: Extremely Concise Approach for Auto-Encoding Generative Adversarial Networks

2019-03-05 · Jianlin Su

In this paper, we propose Orthogonal Generative Adversarial Networks (O-GANs). We decompose the network of discriminator orthogonally and add an extra loss into the objective of common GANs, which can enforce discriminat…

Generative Adversarial Network