GAN Inversion for Out-of-Range Images with Geometric Transformations
For successful semantic editing of real images, it is critical for a GAN inversion method to find an in-domain latent code that aligns with the domain of a pre-trained GAN model. Unfortunately, such in-domain latent codes can be found only for in-range images that align with the training images of a GAN model. In this paper, we propose BDInvert, a novel GAN inversion approach to semantic editing of out-of-range images that are geometrically unaligned with the training images of a GAN model. To find a latent code that is semantically editable, BDInvert inverts an input out-of-range image into an alternative latent space than the original latent space. We also propose a regularized inversion method to find a solution that supports semantic editing in the alternative space. Our experiments show that BDInvert effectively supports semantic editing of out-of-range images with geometric transformations.
Code (1)
Similar Papers 제목 키워드 기반
EDICT: Exact Diffusion Inversion via Coupled Transformations
Finding an initial noise vector that produces an input image when fed into the diffusion process (known as inversion) is an important problem in denoising diffusion models (DDMs), with applications for real image editing…
DenoisingImage ReconstructionImage StylizationText-based Image Editing+1A Geometric Analysis of Deep Generative Image Models and Its Applications
Generative adversarial networks have emerged as a powerful unsupervised method to model the statistical patterns of real-world data sets, such as natural images. These networks are trained to map random inputs in their l…
Image-VariationGeometric operations implemented by conformal geometric algebra neural nodes
Geometric algebra is an optimal frame work for calculating with vectors. The geometric algebra of a space includes elements that represent all the its subspaces (lines, planes, volumes, ...). Conformal geometric algebra …
Improving Speech Inversion Through Self-Supervised Embeddings and Enhanced Tract Variables
The performance of deep learning models depends significantly on their capacity to encode input features efficiently and decode them into meaningful outputs. Better input and output representation has the potential to bo…
Self-Supervised LearningMGAug: Multimodal Geometric Augmentation in Latent Spaces of Image Deformations
Geometric transformations have been widely used to augment the size of training images. Existing methods often assume a unimodal distribution of the underlying transformations between images, which limits their power whe…
Image AugmentationMulti-class Classification