OneGAN: Simultaneous Unsupervised Learning of Conditional Image Generation, Foreground Segmentation, and Fine-Grained Clustering
We present a method for simultaneously learning, in an unsupervised manner, (i) a conditional image generator, (ii) foreground extraction and segmentation, (iii) clustering into a two-level class hierarchy, and (iv) object removal and background completion, all done without any use of annotation. The method combines a Generative Adversarial Network and a Variational Auto-Encoder, with multiple encoders, generators and discriminators, and benefits from solving all tasks at once. The input to the training scheme is a varied collection of unlabeled images from the same domain, as well as a set of background images without a foreground object. In addition, the image generator can mix the background from one image, with a foreground that is conditioned either on that of a second image or on the index of a desired cluster. The method obtains state of the art results in comparison to the literature methods, when compared to the current state of the art in each of the tasks.
Code (0)
등록된 구현이 없습니다.
Tasks
ClusteringConditional Image GenerationForeground SegmentationGenerative Adversarial NetworkImage GenerationSimilar Papers 제목 키워드 기반
cFineGAN: Unsupervised multi-conditional fine-grained image generation
We propose an unsupervised multi-conditional image generation pipeline: cFineGAN, that can generate an image conditioned on two input images such that the generated image preserves the texture of one and the shape of the…
Conditional Image GenerationImage GenerationConditional Image-to-Video Generation with Latent Flow Diffusion Models
Conditional image-to-video (cI2V) generation aims to synthesize a new plausible video starting from an image (e.g., a person's face) and a condition (e.g., an action class label like smile). The key challenge of the cI2V…
Image to Video GenerationMotion GenerationOptical Flow EstimationVideo GenerationCoPE: Conditional image generation using Polynomial Expansions
Generative modeling has evolved to a notable field of machine learning. Deep polynomial neural networks (PNNs) have demonstrated impressive results in unsupervised image generation, where the task is to map an input vect…
AttributeConditional Image GenerationImage GenerationImage-to-Image Translation+3Conditional Generation Using Polynomial Expansions
Generative modeling has evolved to a notable field of machine learning. Deep polynomial neural networks (PNNs) have demonstrated impressive results in unsupervised image generation, where the task is to map an input vect…
AttributeImage GenerationImage-to-Image TranslationPolynomial Neural Networks+2Contrastive Conditional-Unconditional Alignment for Long-tailed Diffusion Model
Training data for class-conditional image synthesis often exhibit a long-tailed distribution with limited amount of images for tail classes. Such an imbalance causes mode collapse and reduces the diversity of synthesized…
Image Generation