Learning Transferable Features with Deep Adaptation Networks
Recent studies reveal that a deep neural network can learn transferable features which generalize well to novel tasks for domain adaptation. However, as deep features eventually transition from general to specific along the network, the feature transferability drops significantly in higher layers with increasing domain discrepancy. Hence, it is important to formally reduce the dataset bias and enhance the transferability in task-specific layers. In this paper, we propose a new Deep Adaptation Network (DAN) architecture, which generalizes deep convolutional neural network to the domain adaptation scenario. In DAN, hidden representations of all task-specific layers are embedded in a reproducing kernel Hilbert space where the mean embeddings of different domain distributions can be explicitly matched. The domain discrepancy is further reduced using an optimal multi-kernel selection method for mean embedding matching. DAN can learn transferable features with statistical guarantees, and can scale linearly by unbiased estimate of kernel embedding. Extensive empirical evidence shows that the proposed architecture yields state-of-the-art image classification error rates on standard domain adaptation benchmarks.
Code (5)
Tasks
Domain Adaptationimage-classificationImage ClassificationMulti-Source Unsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Interventional Domain Adaptation
Domain adaptation (DA) aims to transfer discriminative features learned from source domain to target domain. Most of DA methods focus on enhancing feature transferability through domain-invariance learning. However, sour…
counterfactualDomain AdaptationUnsupervised Domain AdaptationTransferable Semantic Augmentation for Domain Adaptation
Domain adaptation has been widely explored by transferring the knowledge from a label-rich source domain to a related but unlabeled target domain. Most existing domain adaptation algorithms attend to adapting feature rep…
Domain AdaptationBridging Adversarial and Statistical Domain Transfer via Spectral Adaptation Networks
Statistical and adversarial adaptation are currently two extensive categories of neural network architectures in unsupervised deep domain adaptation. The latter has become the new standard due to its good theoretical fou…
Domain AdaptationLearning Transferable Features for Speech Emotion Recognition
Emotion recognition from speech is one of the key steps towards emotional intelligence in advanced human-machine interaction. Identifying emotions in human speech requires learning features that are robust and discrimina…
Domain AdaptationEmotional IntelligenceEmotion RecognitionSpeech Emotion RecognitionDeep causal representation learning for unsupervised domain adaptation
Studies show that the representations learned by deep neural networks can be transferred to similar prediction tasks in other domains for which we do not have enough labeled data. However, as we transition to higher laye…
Domain AdaptationRepresentation LearningUnsupervised Domain Adaptation