paper-with-me

Papers

InfoVAEGAN : learning joint interpretable representations by information maximization and maximum likelihood

2021-07-09 · Fei Ye, Adrian G. Bors

Learning disentangled and interpretable representations is an important step towards accomplishing comprehensive data representations on the manifold. In this paper, we propose a novel representation learning algorithm which combines the inference abilities of Variational Autoencoders (VAE) with the generalization capability of Generative Adversarial Networks (GAN). The proposed model, called InfoVAEGAN, consists of three networks~: Encoder, Generator and Discriminator. InfoVAEGAN aims to jointly learn discrete and continuous interpretable representations in an unsupervised manner by using two different data-free log-likelihood functions onto the variables sampled from the generator's distribution. We propose a two-stage algorithm for optimizing the inference network separately from the generator training. Moreover, we enforce the learning of interpretable representations through the maximization of the mutual information between the existing latent variables and those created through generative and inference processes.

📄 PDF Abstract BibTeX arXiv:2107.04705

Code (0)

등록된 구현이 없습니다.

Tasks

Representation Learning

Similar Papers 제목 키워드 기반

Variational Mutual Information Maximization Framework for VAE Latent Codes with Continuous and Discrete Priors

2020-06-02 · Andriy Serdega, Dae-shik Kim

Learning interpretable and disentangled representations of data is a key topic in machine learning research. Variational Autoencoder (VAE) is a scalable method for learning directed latent variable models of complex data…

Physically Interpretable Representation Learning with Gaussian Mixture Variational AutoEncoder (GM-VAE)

2025-11-26 · Tiffany Fan, Murray Cutforth, Marta D'Elia, Alexandre Cortiella 외 arxiv

Extracting compact, physically interpretable representations from high-dimensional scientific data is a persistent challenge due to the complex, nonlinear structures inherent in physical systems. We propose a Gaussian Mi…

Representation Learning

Enhancing Pre-trained Representation Classifiability can Boost its Interpretability

2025-10-28 · Shufan Shen, Zhaobo Qi, Junshu Sun, Qingming Huang 외 arxiv

The visual representation of a pre-trained model prioritizes the classifiability on downstream tasks, while the widespread applications for pre-trained visual models have posed new requirements for representation interpr…

Jointly Learning Semantic Parser and Natural Language Generator via Dual Information Maximization

2019-06-03 · ACL 2019 7 · Hai Ye, Wenjie Li, Lu Wang

Semantic parsing aims to transform natural language (NL) utterances into formal meaning representations (MRs), whereas an NL generator achieves the reverse: producing a NL description for some given MRs. Despite this int…

Code GenerationDialogue ManagementManagementSemantic Parsing

Discovering Interpretable Representations for Both Deep Generative and Discriminative Models

2018-07-01 · ICML 2018 7 · Tameem Adel, Zoubin Ghahramani, Adrian Weller

Interpretability of representations in both deep generative and discriminative models is highly desirable. Current methods jointly optimize an objective combining accuracy and interpretability. However, this may red…

Active Learning