A Discriminative Technique for Multiple-Source Adaptation
We present a new discriminative technique for the multiple-source adaptation, MSA, problem. Unlike previous work, which relies on density estimation for each source domain, our solution only requires conditional probabilities that can easily be accurately estimated from unlabeled data from the source domains. We give a detailed analysis of our new technique, including general guarantees based on R\'enyi divergences, and learning bounds when conditional Maxent is used for estimating conditional probabilities for a point to belong to a source domain. We show that these guarantees compare favorably to those that can be derived for the generative solution, using kernel density estimation. Our experiments with real-world applications further demonstrate that our new discriminative MSA algorithm outperforms the previous generative solution as well as other domain adaptation baselines.
Code (0)
등록된 구현이 없습니다.
Tasks
Density EstimationDomain AdaptationSimilar Papers 제목 키워드 기반
Domain Adaptation for Structured Output via Discriminative Patch Representations
Predicting structured outputs such as semantic segmentation relies on expensive per-pixel annotations to learn supervised models like convolutional neural networks. However, models trained on one data domain may not gene…
Domain AdaptationImage-to-Image TranslationSegmentationSemantic Segmentation+1Multi-source Few-shot Domain Adaptation
Multi-source Domain Adaptation (MDA) aims to transfer predictive models from multiple, fully-labeled source domains to an unlabeled target domain. However, in many applications, relevant labeled source datasets may not b…
Domain AdaptationSelf-Supervised LearningWeighted Joint Maximum Mean Discrepancy Enabled Multi-Source-Multi-Target Unsupervised Domain Adaptation Fault Diagnosis
Despite the remarkable results that can be achieved by data-driven intelligent fault diagnosis techniques, they presuppose the same distribution of training and test data as well as sufficient labeled data. Various opera…
Domain AdaptationFault DiagnosisUnsupervised Domain AdaptationAdversarial Multiple Source Domain Adaptation
While domain adaptation has been actively researched, most algorithms focus on the single-source-single-target adaptation setting. In this paper we propose new generalization bounds and algorithms under both classificati…
ClassificationDomain AdaptationGeneral ClassificationGeneralization Bounds+3Discriminative Radial Domain Adaptation
Domain adaptation methods reduce domain shift typically by learning domain-invariant features. Most existing methods are built on distribution matching, e.g., adversarial domain adaptation, which tends to corrupt feature…
Domain AdaptationDomain GeneralizationUnsupervised Domain Adaptation