paper-with-me

Papers

InvGAN: Invertible GANs

2021-12-08 · Partha Ghosh, Dominik Zietlow, Michael J. Black, Larry S. Davis, Xiaochen Hu

Generation of photo-realistic images, semantic editing and representation learning are a few of many potential applications of high resolution generative models. Recent progress in GANs have established them as an excellent choice for such tasks. However, since they do not provide an inference model, image editing or downstream tasks such as classification can not be done on real images using the GAN latent space. Despite numerous efforts to train an inference model or design an iterative method to invert a pre-trained generator, previous methods are dataset (e.g. human face images) and architecture (e.g. StyleGAN) specific. These methods are nontrivial to extend to novel datasets or architectures. We propose a general framework that is agnostic to architecture and datasets. Our key insight is that, by training the inference and the generative model together, we allow them to adapt to each other and to converge to a better quality model. Our \textbf{InvGAN}, short for Invertible GAN, successfully embeds real images to the latent space of a high quality generative model. This allows us to perform image inpainting, merging, interpolation and online data augmentation. We demonstrate this with extensive qualitative and quantitative experiments.

📄 PDF Abstract BibTeX arXiv:2112.04598

Code (0)

등록된 구현이 없습니다.

Tasks

Data AugmentationImage InpaintingRepresentation Learning

Similar Papers 제목 키워드 기반

Invert and Defend: Model-based Approximate Inversion of Generative Adversarial Networks for Secure Inference

2019-11-23 · Wei-An Lin, Yogesh Balaji, Pouya Samangouei, Rama Chellappa

Inferring the latent variable generating a given test sample is a challenging problem in Generative Adversarial Networks (GANs). In this paper, we propose InvGAN - a novel framework for solving the inference problem in G…

Invertible Conditional GANs for image editing

2016-11-19 · Guim Perarnau, Joost Van de Weijer, Bogdan Raducanu, Jose M. Álvarez

Generative Adversarial Networks (GANs) have recently demonstrated to successfully approximate complex data distributions. A relevant extension of this model is conditional GANs (cGANs), where the introduction of external…

Conditional Image GenerationImage-to-Image Translation

Disentangled Inference for GANs with Latently Invertible Autoencoder

2019-06-19 · Jiapeng Zhu, Deli Zhao, Bo Zhang, Bolei Zhou

Generative Adversarial Networks (GANs) play an increasingly important role in machine learning. However, there is one fundamental issue hindering their practical applications: the absence of capability for encoding real-…

Decoder

AgeFlow: Conditional Age Progression and Regression with Normalizing Flows

2021-05-15 · Zhizhong Huang, Shouzhen Chen, Junping Zhang, Hongming Shan

Age progression and regression aim to synthesize photorealistic appearance of a given face image with aging and rejuvenation effects, respectively. Existing generative adversarial networks (GANs) based methods suffer fro…

AttributeKnowledge Distillationregression

Reversible GANs for Memory-efficient Image-to-Image Translation

2019-02-07 · CVPR 2019 6 · Tycho F. A. van der Ouderaa, Daniel E. Worrall

The Pix2pix and CycleGAN losses have vastly improved the qualitative and quantitative visual quality of results in image-to-image translation tasks. We extend this framework by exploring approximately invertible architec…

Image-to-Image TranslationTranslation