paper-with-me

홈 › Papers

Variational Transfer Learning using Cross-Domain Latent Modulation

2022-05-31 · Jinyong Hou, Jeremiah D. Deng, Stephen Cranefield, Xuejie Din

To successfully apply trained neural network models to new domains, powerful transfer learning solutions are essential. We propose to introduce a novel cross-domain latent modulation mechanism to a variational autoencoder framework so as to achieve effective transfer learning. Our key idea is to procure deep representations from one data domain and use it to influence the reparameterization of the latent variable of another domain. Specifically, deep representations of the source and target domains are first extracted by a unified inference model and aligned by employing gradient reversal. The learned deep representations are then cross-modulated to the latent encoding of the alternative domain, where consistency constraints are also applied. In the empirical validation that includes a number of transfer learning benchmark tasks for unsupervised domain adaptation and image-to-image translation, our model demonstrates competitive performance, which is also supported by evidence obtained from visualization.

📄 PDF Abstract BibTeX arXiv:2205.15523

Code (0)

등록된 구현이 없습니다.

Tasks

Domain AdaptationImage-to-Image TranslationTransfer LearningUnsupervised Domain Adaptation

Similar Papers 제목 키워드 기반

Cross-Domain Latent Modulation for Variational Transfer Learning

2020-12-21 · Jinyong Hou, Jeremiah D. Deng, Stephen Cranefield, Xuejie Ding

We propose a cross-domain latent modulation mechanism within a variational autoencoders (VAE) framework to enable improved transfer learning. Our key idea is to procure deep representations from one data domain and use i…

Domain AdaptationTransfer LearningTranslationUnsupervised Domain Adaptation

Deep Variational Transfer: Transfer Learning through Semi-supervised Deep Generative Models

2018-12-07 · Marouan Belhaj, Pavlos Protopapas, Weiwei Pan

In real-world applications, it is often expensive and time-consuming to obtain labeled examples. In such cases, knowledge transfer from related domains, where labels are abundant, could greatly reduce the need for extens…

General ClassificationTransfer Learning

Latent Domain Transfer: Crossing modalities with Bridging Autoencoders

2019-05-01 · ICLR 2019 5 · Yingtao Tian, Jesse Engel

Domain transfer is a exciting and challenging branch of machine learning because models must learn to smoothly transfer between domains, preserving local variations and capturing many aspects of variation without labels.…

Generative Adversarial Network

A Variational Bayesian Approach to Learning Latent Variables for Acoustic Knowledge Transfer

2021-10-16 · Hu Hu, Sabato Marco Siniscalchi, Chao-Han Huck Yang, Chin-Hui Lee

We propose a variational Bayesian (VB) approach to learning distributions of latent variables in deep neural network (DNN) models for cross-domain knowledge transfer, to address acoustic mismatches between training and t…

Acoustic Scene ClassificationScene ClassificationTransfer Learning

MetaModulation: Learning Variational Feature Hierarchies for Few-Shot Learning with Fewer Tasks

2023-05-17 · Wenfang Sun, Yingjun Du, XianTong Zhen, Fan Wang 외

Meta-learning algorithms are able to learn a new task using previously learned knowledge, but they often require a large number of meta-training tasks which may not be readily available. To address this issue, we propose…

DiversityFew-Shot LearningMeta-Learning