Learning latent representations across multiple data domains using Lifelong VAEGAN
The problem of catastrophic forgetting occurs in deep learning models trained on multiple databases in a sequential manner. Recently, generative replay mechanisms (GRM), have been proposed to reproduce previously learned knowledge aiming to reduce the forgetting. However, such approaches lack an appropriate inference model and therefore can not provide latent representations of data. In this paper, we propose a novel lifelong learning approach, namely the Lifelong VAEGAN (L-VAEGAN), which not only induces a powerful generative replay network but also learns meaningful latent representations, benefiting representation learning. L-VAEGAN can allow to automatically embed the information associated with different domains into several clusters in the latent space, while also capturing semantically meaningful shared latent variables, across different data domains. The proposed model supports many downstream tasks that traditional generative replay methods can not, including interpolation and inference across different data domains.
Code (1)
Tasks
Lifelong learningRepresentation LearningSimilar Papers 제목 키워드 기반
Generating Furry Cars: Disentangling Object Shape & Appearance across Multiple Domains
We consider the novel task of learning disentangled representations of object shape and appearance across multiple domains (e.g., dogs and cars). The goal is to learn a generative model that learns an intermediate distri…
DisentanglementObjectGenerating Furry Cars: Disentangling Object Shape and Appearance across Multiple Domains
We consider the novel task of learning disentangled representations of object shape and appearance across multiple domains (e.g., dogs and cars). The goal is to learn a generative model that learns an intermediate distr…
DisentanglementObjectMetric Space Magnitude for Evaluating the Diversity of Latent Representations
The magnitude of a metric space is a novel invariant that provides a measure of the 'effective size' of a space across multiple scales, while also capturing numerous geometrical properties, such as curvature, density, or…
Dimensionality ReductionDiversityRepresentation LearningTowards Disentangled Representations for Human Retargeting by Multi-view Learning
We study the problem of learning disentangled representations for data across multiple domains and its applications in human retargeting. Our goal is to map an input image to an identity-invariant latent representation t…
MULTI-VIEW LEARNINGJoint Wasserstein Autoencoders for Aligning Multimodal Embeddings
One of the key challenges in learning joint embeddings of multiple modalities, e.g. of images and text, is to ensure coherent cross-modal semantics that generalize across datasets. We propose to address this through join…
Cross-Modal RetrievalRetrieval