QC-StyleGAN -- Quality Controllable Image Generation and Manipulation
The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as desired outputs, making them unfit for in-the-wild low-quality (LQ) images, which are common inputs for manipulation. In this work, we bridge this gap by proposing a novel GAN structure that allows for generating images with controllable quality. The network can synthesize various image degradation and restore the sharp image via a quality control code. Our proposed QC-StyleGAN can directly edit LQ images without altering their quality by applying GAN inversion and manipulation techniques. It also provides for free an image restoration solution that can handle various degradations, including noise, blur, compression artifacts, and their mixtures. Finally, we demonstrate numerous other applications such as image degradation synthesis, transfer, and interpolation. The code is available at https://github.com/VinAIResearch/QC-StyleGAN.
Code (1)
Tasks
Image GenerationImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
StyleGAN of All Trades: Image Manipulation with Only Pretrained StyleGAN
Recently, StyleGAN has enabled various image manipulation and editing tasks thanks to the high-quality generation and the disentangled latent space. However, additional architectures or task-specific training paradigms a…
AllImage ManipulationImage-to-Image TranslationTranslationDisentangled GANs for Controllable Generation of High-Resolution Images
Generative adversarial networks (GANs) have achieved great success at generating realistic samples. However, achieving disentangled and controllable generation still remains challenging for GANs, especially in the high-r…
DisentanglementVocal Bursts Intensity PredictionUrban-StyleGAN: Learning to Generate and Manipulate Images of Urban Scenes
A promise of Generative Adversarial Networks (GANs) is to provide cheap photorealistic data for training and validating AI models in autonomous driving. Despite their huge success, their performance on complex images fea…
Autonomous DrivingDisentanglementFace GenerationScene GenerationGuidedStyle: Attribute Knowledge Guided Style Manipulation for Semantic Face Editing
Although significant progress has been made in synthesizing high-quality and visually realistic face images by unconditional Generative Adversarial Networks (GANs), there still lacks of control over the generation proces…
AttributeImage GenerationNoisyTwins: Class-Consistent and Diverse Image Generation through StyleGANs
StyleGANs are at the forefront of controllable image generation as they produce a latent space that is semantically disentangled, making it suitable for image editing and manipulation. However, the performance of StyleGA…
Conditional Image GenerationDiversityImage Generation