Mutual Calibration between Explicit and Implicit Deep Generative Models
Deep generative models are generally categorized into explicit models and implicit models. The former defines an explicit density form that allows likelihood inference; while the latter targets a flexible transformation from random noise to generated samples. To take full advantages of both models, we propose Stein Bridging, a novel joint training framework that connects an explicit (unnormalized) density estimator and an implicit sample generator via Stein discrepancy. We show that the Stein bridge 1) induces novel mutual regularization via kernel Sobolev norm penalization and Moreau-Yosida regularization, and 2) stabilizes the training dynamics. Empirically, we demonstrate that Stein Bridging can facilitate the density estimator to accurately identify data modes and guide the sample generator to output more high-quality samples especially when the training samples are contaminated or limited.
Code (0)
등록된 구현이 없습니다.
Similar Papers 제목 키워드 기반
Stein Bridging: Enabling Mutual Reinforcement between Explicit and Implicit Generative Models
Deep generative models are generally categorized into explicit models and implicit models. The former assumes an explicit density form whose normalizing constant is often unknown; while the latter, including generative a…
Bridging Explicit and Implicit Deep Generative Models via Neural Stein Estimators
There are two types of deep generative models: explicit and implicit. The former defines an explicit density form that allows likelihood inference; while the latter targets a flexible transformation from random noise to …
Make Explicit Calibration Implicit: Calibrate Denoiser Instead of the Noise Model
Explicit calibration-based methods have dominated RAW image denoising under extremely low-light environments. However, these methods are impeded by several critical limitations: a) the explicit calibration process is bot…
DenoisingImage DenoisingCamera Pose Estimation Using Implicit Distortion Models
Low-dimensional parametric models are the de-facto standard in computer vision for intrinsic camera calibration. These models explicitly describe the mapping between incoming viewing rays and image pixels. In this pa…
Camera CalibrationCamera Pose EstimationPose EstimationVisual LocalizationIRRGN: An Implicit Relational Reasoning Graph Network for Multi-turn Response Selection
The task of response selection in multi-turn dialogue is to find the best option from all candidates. In order to improve the reasoning ability of the model, previous studies pay more attention to using explicit algorith…
Relational Reasoning