Image Manipulation with Perceptual Discriminators
Systems that perform image manipulation using deep convolutional networks have achieved remarkable realism. Perceptual losses and losses based on adversarial discriminators are the two main classes of learning objectives behind these advances. In this work, we show how these two ideas can be combined in a principled and non-additive manner for unaligned image translation tasks. This is accomplished through a special architecture of the discriminator network inside generative adversarial learning framework. The new architecture, that we call a perceptual discriminator, embeds the convolutional parts of a pre-trained deep classification network inside the discriminator network. The resulting architecture can be trained on unaligned image datasets while benefiting from the robustness and efficiency of perceptual losses. We demonstrate the merits of the new architecture in a series of qualitative and quantitative comparisons with baseline approaches and state-of-the-art frameworks for unaligned image translation.
Code (0)
등록된 구현이 없습니다.
Tasks
Image ManipulationTranslationSimilar Papers 제목 키워드 기반
On the Effectiveness of Spectral Discriminators for Perceptual Quality Improvement
Several recent studies advocate the use of spectral discriminators, which evaluate the Fourier spectra of images for generative modeling. However, the effectiveness of the spectral discriminators is not well interpreted …
Image Quality AssessmentImage Super-ResolutionNo-Reference Image Quality AssessmentSuper-ResolutionStructure-Guided Image Completion with Image-level and Object-level Semantic Discriminators
Structure-guided image completion aims to inpaint a local region of an image according to an input guidance map from users. While such a task enables many practical applications for interactive editing, existing methods …
ObjectSuper-Resolved Image Perceptual Quality Improvement via Multi-Feature Discriminators
Generative adversarial network (GAN) for image super-resolution (SR) has attracted enormous interests in recent years. However, the GAN-based SR methods only use image discriminator to distinguish SR images and high-reso…
Generative Adversarial NetworkImage Super-ResolutionSuper-ResolutionEfficient Unpaired Image Dehazing with Cyclic Perceptual-Depth Supervision
Image dehazing without paired haze-free images is of immense importance, as acquiring paired images often entails significant cost. However, we observe that previous unpaired image dehazing approaches tend to suffer from…
Image DehazingX-GANs: Image Reconstruction Made Easy for Extreme Cases
Image reconstruction including image restoration and denoising is a challenging problem in the field of image computing. We present a new method, called X-GANs, for reconstruction of arbitrary corrupted resource based on…
DenoisingImage CompressionImage DenoisingImage Inpainting+2