Learning Implicit Generative Models by Matching Perceptual Features
Perceptual features (PFs) have been used with great success in tasks such as transfer learning, style transfer, and super-resolution. However, the efficacy of PFs as key source of information for learning generative models is not well studied. We investigate here the use of PFs in the context of learning implicit generative models through moment matching (MM). More specifically, we propose a new effective MM approach that learns implicit generative models by performing mean and covariance matching of features extracted from pretrained ConvNets. Our proposed approach improves upon existing MM methods by: (1) breaking away from the problematic min/max game of adversarial learning; (2) avoiding online learning of kernel functions; and (3) being efficient with respect to both number of used moments and required minibatch size. Our experimental results demonstrate that, due to the expressiveness of PFs from pretrained deep ConvNets, our method achieves state-of-the-art results for challenging benchmarks.
Code (0)
등록된 구현이 없습니다.
Tasks
Style TransferSuper-ResolutionTransfer LearningSimilar Papers 제목 키워드 기반
Objective Quality Assessment of Point Clouds Using Multi-scale Implicit Structural Similarity
The unstructured and irregular nature of points poses a significant challenge for accurate point cloud quality assessment (PCQA), particularly in establishing accurate perceptual feature correspondence. To tackle this, w…
Point Cloud Quality AssessmentPoint CloudsLearning Implicit Text Generation via Feature Matching
Generative feature matching network (GFMN) is an approach for training implicit generative models for images by performing moment matching on features from pre-trained neural networks. In this paper, we present new GFMN …
Conditional Text GenerationStyle TransferText GenerationText Style Transfer+1Perceptual Flow Matching for Few-Step Generative Modeling
We propose Perceptual Flow Matching (PFM), a simple yet effective framework for few-step generation in flow-matching models. Rather than performing velocity regression in the conventional VAE latent space, PFM supervises…
Image GenerationVideo GenerationImage EditingThe Unreasonable Effectiveness of Texture Transfer for Single Image Super-resolution
While implicit generative models such as GANs have shown impressive results in high quality image reconstruction and manipulation using a combination of various losses, we consider a simpler approach leading to surprisin…
General ClassificationImage ReconstructionImage Super-ResolutionSuper-ResolutionMatching Thermal to Visible Face Images Using a Semantic-Guided Generative Adversarial Network
Designing face recognition systems that are capable of matching face images obtained in the thermal spectrum with those obtained in the visible spectrum is a challenging problem. In this work, we propose the use of seman…
Face GenerationFace ParsingFace RecognitionGenerative Adversarial Network