paper-with-me

Papers

Art Creation with Multi-Conditional StyleGANs

2022-02-23 · Konstantin Dobler, Florian Hübscher, Jan Westphal, Alejandro Sierra-Múnera, Gerard de Melo, Ralf Krestel

Creating meaningful art is often viewed as a uniquely human endeavor. A human artist needs a combination of unique skills, understanding, and genuine intention to create artworks that evoke deep feelings and emotions. In this paper, we introduce a multi-conditional Generative Adversarial Network (GAN) approach trained on large amounts of human paintings to synthesize realistic-looking paintings that emulate human art. Our approach is based on the StyleGAN neural network architecture, but incorporates a custom multi-conditional control mechanism that provides fine-granular control over characteristics of the generated paintings, e.g., with regard to the perceived emotion evoked in a spectator. For better control, we introduce the conditional truncation trick, which adapts the standard truncation trick for the conditional setting and diverse datasets. Finally, we develop a diverse set of evaluation techniques tailored to multi-conditional generation.

📄 PDF Abstract BibTeX arXiv:2202.11777

Code (1)

konstantinjdobler/multi-conditional-stylegan 공식 구현 pytorch

Tasks

Generative Adversarial Network

Methods 이 논문이 사용한 방법론

StyleGAN 설명 없음
Dense Connections Dense Connections, or Fully Connected Connections, are a type of layer in a deep neural network that use a linear operation where every input is connected to every output…
Adaptive Instance Normalization 설명 없음
Convolution A convolution is a type of matrix operation, consisting of a kernel, a small matrix of weights, that slides over input data performing element-wise multiplication with the…
Feedforward Network A Feedforward Network, or a Multilayer Perceptron (MLP), is a neural network with solely densely connected layers. This is the classic neural network architecture of the…
R1 Regularization R_INLINE_MATH_1 Regularization is a regularization technique and gradient penalty for training [generative adversarial…
HuMan(Expedia)||How do I get a human at Expedia? How do I get a human at Expedia? How Do I Get a Human at Expedia? – Call ☎️ +1-(888) 829 (0881) or +1-805-330-4056 or +1-805-330-4056 for Real-Time Help & Exclusive…
Truncation Trick The Truncation Trick is a latent sampling procedure for generative adversarial networks, where we sample $z$ from a truncated normal (where values which fall outside a range…

Similar Papers 제목 키워드 기반

MPG: A Multi-ingredient Pizza Image Generator with Conditional StyleGANs

2020-12-04 · Fangda Han, Guoyao Hao, Ricardo Guerrero, Vladimir Pavlovic

Multilabel conditional image generation is a challenging problem in computer vision. In this work we propose Multi-ingredient Pizza Generator (MPG), a conditional Generative Neural Network (GAN) framework for synthesizin…

Conditional Image GenerationImage Generation

NoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs

2023-04-12 · CVPR 2023 1 · Harsh Rangwani, Lavish Bansal, Kartik Sharma, Tejan Karmali 외

StyleGANs are at the forefront of controllable image generation as they produce a latent space that is semantically disentangled, making it suitable for image editing and manipulation. However, the performance of StyleGA…

Conditional Image GenerationDiversityImage Generation

SemanticStyleGAN: Learning Compositional Generative Priors for Controllable Image Synthesis and Editing

2021-12-04 · CVPR 2022 1 · Yichun Shi, Xiao Yang, Yangyue Wan, Xiaohui Shen

Recent studies have shown that StyleGANs provide promising prior models for downstream tasks on image synthesis and editing. However, since the latent codes of StyleGANs are designed to control global styles, it is hard …

DisentanglementFacial EditingImage GenerationTransfer Learning

Revisiting Latent Space of GAN Inversion for Real Image Editing

2023-07-18 · Kai Katsumata, Duc Minh Vo, Bei Liu, Hideki Nakayama

The exploration of the latent space in StyleGANs and GAN inversion exemplify impressive real-world image editing, yet the trade-off between reconstruction quality and editing quality remains an open problem. In this stud…

Example-Based Framework for Perceptually Guided Audio Texture Generation

2023-08-23 · Purnima Kamath, Chitralekha Gupta, Lonce Wyse, Suranga Nanayakkara

Controllable generation using StyleGANs is usually achieved by training the model using labeled data. For audio textures, however, there is currently a lack of large semantically labeled datasets. Therefore, to control g…

AttributeTexture Synthesis