Disentangled Interleaving Variational Encoding
Conflicting objectives present a considerable challenge in interleaving multi-task learning, necessitating the need for meticulous design and balance to ensure effective learning of a representative latent data space across all tasks without mutual negative impact. Drawing inspiration from the concept of marginal and conditional probability distributions in probability theory, we design a principled and well-founded approach to disentangle the original input into marginal and conditional probability distributions in the latent space of a variational autoencoder. Our proposed model, Deep Disentangled Interleaving Variational Encoding (DeepDIVE) learns disentangled features from the original input to form clusters in the embedding space and unifies these features via the cross-attention mechanism in the fusion stage. We theoretically prove that combining the objectives for reconstruction and forecasting fully captures the lower bound and mathematically derive a loss function for disentanglement using Na\"ive Bayes. Under the assumption that the prior is a mixture of log-concave distributions, we also establish that the Kullback-Leibler divergence between the prior and the posterior is upper bounded by a function minimized by the minimizer of the cross entropy loss, informing our adoption of radial basis functions (RBF) and cross entropy with interleaving training for DeepDIVE to provide a justified basis for convergence. Experiments on two public datasets show that DeepDIVE disentangles the original input and yields forecast accuracies better than the original VAE and comparable to existing state-of-the-art baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
DisentanglementMulti-Task LearningSimilar Papers 제목 키워드 기반
Variational Tracking and Prediction with Generative Disentangled State-Space Models
We address tracking and prediction of multiple moving objects in visual data streams as inference and sampling in a disentangled latent state-space model. By encoding objects separately and including explicit position in…
Bayesian InferencePositionState Space ModelsDisentangled Representation Learning Using ($β$-)VAE and GAN
Given a dataset of images containing different objects with different features such as shape, size, rotation, and x-y position; and a Variational Autoencoder (VAE); creating a disentangled encoding of these features in t…
DisentanglementGenerative Adversarial NetworkImage ReconstructionPosition+1Unsupervised Disentanglement without Autoencoding: Pitfalls and Future Directions
Disentangled visual representations have largely been studied with generative models such as Variational AutoEncoders (VAEs). While prior work has focused on generative methods for disentangled representation learning, t…
Contrastive LearningDisentanglementRepresentation LearningSensitivityDisentanglement with Hyperspherical Latent Spaces using Diffusion Variational Autoencoders
A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a dis…
DisentanglementDisentanglement with Hyperspherical Latent Spaces using Diffusion Variational Autoencoders
A disentangled representation of a data set should be capable of recovering the underlying factors that generated it. One question that arises is whether using Euclidean space for latent variable models can produce a dis…
Disentanglement