paper-with-me

홈 › Papers

A Bayesian Non-parametric Approach to Generative Models: Integrating Variational Autoencoder and Generative Adversarial Networks using Wasserstein and Maximum Mean Discrepancy

2023-08-27 · Forough Fazeli-Asl, Michael Minyi Zhang

We propose a novel generative model within the Bayesian non-parametric learning (BNPL) framework to address some notable failure modes in generative adversarial networks (GANs) and variational autoencoders (VAEs)--these being overfitting in the GAN case and noisy samples in the VAE case. We will demonstrate that the BNPL framework enhances training stability and provides robustness and accuracy guarantees when incorporating the Wasserstein distance and maximum mean discrepancy measure (WMMD) into our model's loss function. Moreover, we introduce a so-called ``triple model'' that combines the GAN, the VAE, and further incorporates a code-GAN (CGAN) to explore the latent space of the VAE. This triple model design generates high-quality, diverse samples, while the BNPL framework, leveraging the WMMD loss function, enhances training stability. Together, these components enable our model to achieve superior performance across various generative tasks. These claims are supported by both theoretical analyses and empirical validation on a wide variety of datasets.

📄 PDF Abstract BibTeX arXiv:2308.14048

Code (0)

등록된 구현이 없습니다.

Tasks

Anomaly DetectionData Augmentation

Similar Papers 제목 키워드 기반

Streaming Adaptive Nonparametric Variational Autoencoder

2019-06-07 · Tingting Zhao, Zifeng Wang, Aria Masoomi, Jennifer G. Dy

We develop a data driven approach to perform clustering and end-to-end feature learning simultaneously for streaming data that can adaptively detect novel clusters in emerging data. Our approach, Adaptive Nonparametric V…

ClusteringFeature EngineeringVariational Inference

Nonparametric Variational Auto-encoders for Hierarchical Representation Learning

2017-03-21 · ICCV 2017 10 · Prasoon Goyal, Zhiting Hu, Xiaodan Liang, Chenyu Wang 외

The recently developed variational autoencoders (VAEs) have proved to be an effective confluence of the rich representational power of neural networks with Bayesian methods. However, most work on VAEs use a rather simple…

ClusteringRepresentation LearningVariational Inference

Stick-Breaking Variational Autoencoders

2016-05-20 · Eric Nalisnick, Padhraic Smyth

We extend Stochastic Gradient Variational Bayes to perform posterior inference for the weights of Stick-Breaking processes. This development allows us to define a Stick-Breaking Variational Autoencoder (SB-VAE), a Bayesi…

Least Square Variational Bayesian Autoencoder with Regularization

2017-07-11 · arXiv 2017 7 · Gautam Ramachandra

In recent years Variation Autoencoders have become one of the most popular unsupervised learning of complicated distributions.Variational Autoencoder (VAE) provides more efficient reconstructive performance over a tradit…

A Variational AutoEncoder for Transformers with Nonparametric Variational Information Bottleneck

2022-07-27 · James Henderson, Fabio Fehr

We propose a VAE for Transformers by developing a variational information bottleneck regulariser for Transformer embeddings. We formalise the embedding space of Transformer encoders as mixture probability distributions, …

Decoder