Image Inpainting using Block-wise Procedural Training with Annealed Adversarial Counterpart
Recent advances in deep generative models have shown promising potential in image inpanting, which refers to the task of predicting missing pixel values of an incomplete image using the known context. However, existing methods can be slow or generate unsatisfying results with easily detectable flaws. In addition, there is often perceivable discontinuity near the holes and require further post-processing to blend the results. We present a new approach to address the difficulty of training a very deep generative model to synthesize high-quality photo-realistic inpainting. Our model uses conditional generative adversarial networks (conditional GANs) as the backbone, and we introduce a novel block-wise procedural training scheme to stabilize the training while we increase the network depth. We also propose a new strategy called adversarial loss annealing to reduce the artifacts. We further describe several losses specifically designed for inpainting and show their effectiveness. Extensive experiments and user-study show that our approach outperforms existing methods in several tasks such as inpainting, face completion and image harmonization. Finally, we show our framework can be easily used as a tool for interactive guided inpainting, demonstrating its practical value to solve common real-world challenges.
Code (0)
등록된 구현이 없습니다.
Tasks
Facial InpaintingImage HarmonizationImage InpaintingSimilar Papers 제목 키워드 기반
Reconstructing Existing Levels through Level Inpainting
Procedural Content Generation (PCG) and Procedural Content Generation via Machine Learning (PCGML) have been used in prior work for generating levels in various games. This paper introduces Content Augmentation and focus…
Image InpaintingGIID-Net: Generalizable Image Inpainting Detection via Neural Architecture Search and Attention
Deep learning (DL) has demonstrated its powerful capabilities in the field of image inpainting, which could produce visually plausible results. Meanwhile, the malicious use of advanced image inpainting tools (e.g. removi…
Image InpaintingNeural Architecture SearchLocalization of Deep Inpainting Using High-Pass Fully Convolutional Network
Image inpainting has been substantially improved with deep learning in the past years. Deep inpainting can fill image regions with plausible contents, which are not visually apparent. Although inpainting is originally de…
Image InpaintingImage Manipulation DetectionVocal Bursts Intensity PredictionDomain Decomposition Algorithms for Real-time Homogeneous Diffusion Inpainting in 4K
Inpainting-based compression methods are qualitatively promising alternatives to transform-based codecs, but they suffer from the high computational cost of the inpainting step. This prevents them from being applicable t…
4kLeveraging Inpainting for Single-Image Shadow Removal
Fully-supervised shadow removal methods achieve the best restoration qualities on public datasets but still generate some shadow remnants. One of the reasons is the lack of large-scale shadow & shadow-free image pairs. U…
DecoderImage InpaintingImage Shadow RemovalShadow Removal