paper-with-me

홈 › Papers

Exploring Attribute Variations in Style-based GANs using Diffusion Models

2023-11-27 · Rishubh Parihar, Prasanna Balaji, Raghav Magazine, Sarthak Vora, Tejan Karmali, Varun Jampani, R. Venkatesh Babu

Existing attribute editing methods treat semantic attributes as binary, resulting in a single edit per attribute. However, attributes such as eyeglasses, smiles, or hairstyles exhibit a vast range of diversity. In this work, we formulate the task of \textit{diverse attribute editing} by modeling the multidimensional nature of attribute edits. This enables users to generate multiple plausible edits per attribute. We capitalize on disentangled latent spaces of pretrained GANs and train a Denoising Diffusion Probabilistic Model (DDPM) to learn the latent distribution for diverse edits. Specifically, we train DDPM over a dataset of edit latent directions obtained by embedding image pairs with a single attribute change. This leads to latent subspaces that enable diverse attribute editing. Applying diffusion in the highly compressed latent space allows us to model rich distributions of edits within limited computational resources. Through extensive qualitative and quantitative experiments conducted across a range of datasets, we demonstrate the effectiveness of our approach for diverse attribute editing. We also showcase the results of our method applied for 3D editing of various face attributes.

📄 PDF Abstract BibTeX arXiv:2311.16052

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeDenoisingDiversity

Methods 이 논문이 사용한 방법론

Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Householder Projector for Unsupervised Latent Semantics Discovery

2023-07-16 · ICCV 2023 1 · Yue Song, Jichao Zhang, Nicu Sebe, Wei Wang

Generative Adversarial Networks (GANs), especially the recent style-based generators (StyleGANs), have versatile semantics in the structured latent space. Latent semantics discovery methods emerge to move around the late…

MOST-GAN: 3D Morphable StyleGAN for Disentangled Face Image Manipulation

2021-11-01 · Safa C. Medin, Bernhard Egger, Anoop Cherian, Ye Wang 외

Recent advances in generative adversarial networks (GANs) have led to remarkable achievements in face image synthesis. While methods that use style-based GANs can generate strikingly photorealistic face images, it is oft…

DisentanglementImage GenerationImage Manipulation

LatRef-Diff: Latent and Reference-Guided Diffusion for Facial Attribute Editing and Style Manipulation

2026-04-23 · Wenmin Huang, Weiqi Luo, Xiaochun Cao, Jiwu Huang arxiv

Facial attribute editing and style manipulation are crucial for applications like virtual avatars and photo editing. However, achieving precise control over facial attributes without altering unrelated features is challe…

Analyzing the Latent Space of GAN through Local Dimension Estimation

2022-05-26 · Jaewoong Choi, Geonho Hwang, Hyunsoo Cho, Myungjoo Kang

The impressive success of style-based GANs (StyleGANs) in high-fidelity image synthesis has motivated research to understand the semantic properties of their latent spaces. In this paper, we approach this problem through…

AttributeDisentanglementImage Generation

Hierarchical Semantic Regularization of Latent Spaces in StyleGANs

2022-08-07 · Tejan Karmali, Rishubh Parihar, Susmit Agrawal, Harsh Rangwani 외

Progress in GANs has enabled the generation of high-resolution photorealistic images of astonishing quality. StyleGANs allow for compelling attribute modification on such images via mathematical operations on the latent …

Attribute