paper-with-me

홈 › Papers

Style and Content Disentanglement in Generative Adversarial Networks

2018-11-14 · Hadi Kazemi, Seyed Mehdi Iranmanesh, Nasser M. Nasrabadi

Disentangling factors of variation within data has become a very challenging problem for image generation tasks. Current frameworks for training a Generative Adversarial Network (GAN), learn to disentangle the representations of the data in an unsupervised fashion and capture the most significant factors of the data variations. However, these approaches ignore the principle of content and style disentanglement in image generation, which means their learned latent code may alter the content and style of the generated images at the same time. This paper describes the Style and Content Disentangled GAN (SC-GAN), a new unsupervised algorithm for training GANs that learns disentangled style and content representations of the data. We assume that the representation of an image can be decomposed into a content code that represents the geometrical information of the data, and a style code that captures textural properties. Consequently, by fixing the style portion of the latent representation, we can generate diverse images in a particular style. Reversely, we can set the content code and generate a specific scene in a variety of styles. The proposed SC-GAN has two components: a content code which is the input to the generator, and a style code which modifies the scene style through modification of the Adaptive Instance Normalization (AdaIN) layers' parameters. We evaluate the proposed SC-GAN framework on a set of baseline datasets.

📄 PDF Abstract BibTeX arXiv:1811.05621

Code (0)

등록된 구현이 없습니다.

Tasks

DisentanglementGenerative Adversarial NetworkImage Generation

Methods 이 논문이 사용한 방법론

Adaptive Instance Normalization 설명 없음

Similar Papers 제목 키워드 기반

Diagonal Attention and Style-based GAN for Content-Style Disentanglement in Image Generation and Translation

2021-03-30 · ICCV 2021 10 · Gihyun Kwon, Jong Chul Ye

One of the important research topics in image generative models is to disentangle the spatial contents and styles for their separate control. Although StyleGAN can generate content feature vectors from random noises, the…

DisentanglementImage GenerationTranslation

Adversarial Disentanglement with Grouped Observations

2020-01-14 · Jozsef Nemeth

We consider the disentanglement of the representations of the relevant attributes of the data (content) from all other factors of variations (style) using Variational Autoencoders. Some recent works addressed this proble…

Disentanglement

Disentangling Style and Content in Anime Illustrations

2019-05-26 · Sitao Xiang, Hao Li

Existing methods for AI-generated artworks still struggle with generating high-quality stylized content, where high-level semantics are preserved, or separating fine-grained styles from various artists. We propose a nove…

DisentanglementStyle Transfer

Conditional Generation of Medical Images via Disentangled Adversarial Inference

2020-12-08 · Mohammad Havaei, Ximeng Mao, Yiping Wang, Qicheng Lao

Synthetic medical image generation has a huge potential for improving healthcare through many applications, from data augmentation for training machine learning systems to preserving patient privacy. Conditional Adversar…

Data AugmentationDisentanglementImage GenerationMedical Image Generation

SCFlow: Implicitly Learning Style and Content Disentanglement with Flow Models

2025-08-05 · Pingchuan Ma, Xiaopei Yang, Yusong Li, Ming Gui 외 arxiv

Explicitly disentangling style and content in vision models remains challenging due to their semantic overlap and the subjectivity of human perception. Existing methods propose separation through generative or discrimina…