paper-with-me

Papers

Multi-Attribute Balanced Sampling for Disentangled GAN Controls

2021-10-28 · Perla Doubinsky, Nicolas Audebert, Michel Crucianu, Hervé Le Borgne

Various controls over the generated data can be extracted from the latent space of a pre-trained GAN, as it implicitly encodes the semantics of the training data. The discovered controls allow to vary semantic attributes in the generated images but usually lead to entangled edits that affect multiple attributes at the same time. Supervised approaches typically sample and annotate a collection of latent codes, then train classifiers in the latent space to identify the controls. Since the data generated by GANs reflects the biases of the original dataset, so do the resulting semantic controls. We propose to address disentanglement by subsampling the generated data to remove over-represented co-occuring attributes thus balancing the semantics of the dataset before training the classifiers. We demonstrate the effectiveness of this approach by extracting disentangled linear directions for face manipulation on two popular GAN architectures, PGGAN and StyleGAN, and two datasets, CelebAHQ and FFHQ. We show that this approach outperforms state-of-the-art classifier-based methods while avoiding the need for disentanglement-enforcing post-processing.

📄 PDF Abstract BibTeX arXiv:2111.00909

Code (1)

perladoubinsky/balanced_sampling_gan_controls tf

Tasks

AttributeDisentanglement

Methods 이 논문이 사용한 방법론

Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adaptive Instance Normalization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…

Similar Papers 제목 키워드 기반

StyleSpace Analysis: Disentangled Controls for StyleGAN Image Generation

2020-11-25 · CVPR 2021 1 · Zongze Wu, Dani Lischinski, Eli Shechtman

We explore and analyze the latent style space of StyleGAN2, a state-of-the-art architecture for image generation, using models pretrained on several different datasets. We first show that StyleSpace, the space of channel…

AttributeImage Generation

Multi-Aspect Controllable Text Generation with Disentangled Counterfactual Augmentation

2024-05-30 · Yi Liu, Xiangyu Liu, Xiangrong Zhu, Wei Hu

Multi-aspect controllable text generation aims to control the generated texts in attributes from multiple aspects (e.g., "positive" from sentiment and "sport" from topic). For ease of obtaining training samples, existing…

AttributecounterfactualDisentanglementText Generation

Dynamic Curriculum Learning for Imbalanced Data Classification

2019-01-21 · ICCV 2019 10 · Yiru Wang, Weihao Gan, Jie Yang, Wei Wu 외

Human attribute analysis is a challenging task in the field of computer vision, since the data is largely imbalance-distributed. Common techniques such as re-sampling and cost-sensitive learning require prior-knowledge t…

AttributeClassificationGeneral ClassificationMetric Learning

Toward responsible face datasets: modeling the distribution of a disentangled latent space for sampling face images from demographic groups

2023-09-15 · Parsa Rahimi, Christophe Ecabert, Sebastien Marcel

Recently, it has been exposed that some modern facial recognition systems could discriminate specific demographic groups and may lead to unfair attention with respect to various facial attributes such as gender and origi…

Everything is There in Latent Space: Attribute Editing and Attribute Style Manipulation by StyleGAN Latent Space Exploration

2022-07-20 · Rishubh Parihar, Ankit Dhiman, Tejan Karmali, R. Venkatesh Babu

Unconstrained Image generation with high realism is now possible using recent Generative Adversarial Networks (GANs). However, it is quite challenging to generate images with a given set of attributes. Recent methods use…

AttributeImage Generation