paper-with-me

홈 › Papers

Stein Bridging: Enabling Mutual Reinforcement between Explicit and Implicit Generative Models

2019-09-25 · Qitian Wu, Rui Gao, Hongyuan Zha

Deep generative models are generally categorized into explicit models and implicit models. The former assumes an explicit density form whose normalizing constant is often unknown; while the latter, including generative adversarial networks (GANs), generates samples using a push-forward mapping. In spite of substantial recent advances demonstrating the power of the two classes of generative models in many applications, both of them, when used alone, suffer from respective limitations and drawbacks. To mitigate these issues, we propose Stein Bridging, a novel joint training framework that connects an explicit density estimator and an implicit sample generator with Stein discrepancy. We show that the Stein Bridge induces new regularization schemes for both explicit and implicit models. Convergence analysis and extensive experiments demonstrate that the Stein Bridging i) improves the stability and sample quality of the GAN training, and ii) facilitates the density estimator to seek more modes in data and alleviate the mode-collapse issue. Additionally, we discuss several applications of Stein Bridging and useful tricks in practical implementation used in our experiments.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Mutual Calibration between Explicit and Implicit Deep Generative Models

2021-01-01 · Qitian Wu, Rui Gao, Hongyuan Zha

Deep generative models are generally categorized into explicit models and implicit models. The former defines an explicit density form that allows likelihood inference; while the latter targets a flexible transformation …

Wasserstein Dependency Measure for Representation Learning

2019-03-28 · NeurIPS 2019 12 · Sherjil Ozair, Corey Lynch, Yoshua Bengio, Aaron van den Oord 외

Mutual information maximization has emerged as a powerful learning objective for unsupervised representation learning obtaining state-of-the-art performance in applications such as object recognition, speech recognition,…

Object Recognitionreinforcement-learningReinforcement LearningReinforcement Learning (RL)+4

Bridging Imagination and Reality for Model-Based Deep Reinforcement Learning

2020-10-23 · NeurIPS 2020 12 · Guangxiang Zhu, Minghao Zhang, Honglak Lee, Chongjie Zhang

Sample efficiency has been one of the major challenges for deep reinforcement learning. Recently, model-based reinforcement learning has been proposed to address this challenge by performing planning on imaginary traject…

Deep Reinforcement LearningModel-based Reinforcement Learningreinforcement-learningReinforcement Learning+1

Mutual Wasserstein Discrepancy Minimization for Sequential Recommendation

2023-01-28 · Ziwei Fan, Zhiwei Liu, Hao Peng, Philip S Yu

Self-supervised sequential recommendation significantly improves recommendation performance by maximizing mutual information with well-designed data augmentations. However, the mutual information estimation is based on t…

Contrastive LearningMutual Information EstimationSelf-Supervised LearningSequential Recommendation

Task Adaptation from Skills: Information Geometry, Disentanglement, and New Objectives for Unsupervised Reinforcement Learning

2025-06-12 · Yucheng Yang, Tianyi Zhou, Qiang He, Lei Han 외

Unsupervised reinforcement learning (URL) aims to learn general skills for unseen downstream tasks. Mutual Information Skill Learning (MISL) addresses URL by maximizing the mutual information between states and skills bu…

DisentanglementDiversityUnsupervised Reinforcement Learning