Robust Unsupervised StyleGAN Image Restoration
GAN-based image restoration inverts the generative process to repair images corrupted by known degradations. Existing unsupervised methods must be carefully tuned for each task and degradation level. In this work, we make StyleGAN image restoration robust: a single set of hyperparameters works across a wide range of degradation levels. This makes it possible to handle combinations of several degradations, without the need to retune. Our proposed approach relies on a 3-phase progressive latent space extension and a conservative optimizer, which avoids the need for any additional regularization terms. Extensive experiments demonstrate robustness on inpainting, upsampling, denoising, and deartifacting at varying degradations levels, outperforming other StyleGAN-based inversion techniques. Our approach also favorably compares to diffusion-based restoration by yielding much more realistic inversion results. Code is available at https://lvsn.github.io/RobustUnsupervised/.
Code (1)
Tasks
DenoisingImage RestorationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Face Generation and Editing with StyleGAN: A Survey
Our goal with this survey is to provide an overview of the state of the art deep learning methods for face generation and editing using StyleGAN. The survey covers the evolution of StyleGAN, from PGGAN to StyleGAN3, and …
Deep LearningFace GenerationFace SwappingStyle Transfer+1QC-StyleGAN -- Quality Controllable Image Generation and Manipulation
The introduction of high-quality image generation models, particularly the StyleGAN family, provides a powerful tool to synthesize and manipulate images. However, existing models are built upon high-quality (HQ) data as …
Image GenerationImage RestorationPanini-Net: GAN Prior Based Degradation-Aware Feature Interpolation for Face Restoration
Emerging high-quality face restoration (FR) methods often utilize pre-trained GAN models (\textit{i.e.}, StyleGAN2) as GAN Prior. However, these methods usually struggle to balance realness and fidelity when facing vario…
Representation LearningSuper-ResolutionFine-Tuning StyleGAN2 For Cartoon Face Generation
Recent studies have shown remarkable success in the unsupervised image to image (I2I) translation. However, due to the imbalance in the data, learning joint distribution for various domains is still very challenging. Alt…
Face GenerationImage-to-Image TranslationTranslationEnhancing Quality of Pose-varied Face Restoration with Local Weak Feature Sensing and GAN Prior
Facial semantic guidance (including facial landmarks, facial heatmaps, and facial parsing maps) and facial generative adversarial networks (GAN) prior have been widely used in blind face restoration (BFR) in recent years…
Blind Face RestorationSuper-Resolution