Stochastic Classifiers for Unsupervised Domain Adaptation
A common strategy adopted by existing state-of-the-art unsupervised domain adaptation (UDA) methods is to employ two classifiers to identify the misaligned local regions between source and target domain. Following the 'wisdom of the crowd' principle, one has to ask: why stop at two? Indeed, we find that using more classifiers leads to better performance, but also introduces more model parameters, therefore risking overfitting. In this paper, we introduce a novel method called STochastic clAssifieRs (STAR) for addressing this problem. Instead of representing one classifier as a weight vector, STAR models it as a Gaussian distribution with its variance representing the inter-classifier discrepancy. With STAR, we can now sample an arbitrary number of classifiers from the distribution, whilst keeping the model size the same as having two classifiers. Extensive experiments demonstrate that a variety of existing UDA methods can greatly benefit from STAR and achieve the state-of-the-art performance on both image classification and semantic segmentation tasks.
Code (3)
Tasks
Domain Adaptationimage-classificationImage ClassificationSemantic SegmentationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Domain Gap Estimation for Source Free Unsupervised Domain Adaptation with Many Classifiers
In theory, the success of unsupervised domain adaptation (UDA) largely relies on domain gap estimation. However, for source free UDA, the source domain data can not be accessed during adaptation, which poses great challe…
Domain AdaptationUnsupervised Domain AdaptationBi-Directional Generation for Unsupervised Domain Adaptation
Unsupervised domain adaptation facilitates the unlabeled target domain relying on well-established source domain information. The conventional methods forcefully reducing the domain discrepancy in the latent space will r…
Domain AdaptationUnsupervised Domain AdaptationModel Selection with Nonlinear Embedding for Unsupervised Domain Adaptation
Domain adaptation deals with adapting classifiers trained on data from a source distribution, to work effectively on data from a target distribution. In this paper, we introduce the Nonlinear Embedding Transform (NET) fo…
Domain AdaptationGeneral ClassificationModel SelectionUnsupervised Domain AdaptationDomain Consistency Regularization for Unsupervised Multi-source Domain Adaptive Classification
Deep learning-based multi-source unsupervised domain adaptation (MUDA) has been actively studied in recent years. Compared with single-source unsupervised domain adaptation (SUDA), domain shift in MUDA exists not only be…
ClassificationDomain AdaptationMulti-Source Unsupervised Domain AdaptationPseudo Label+1Unsupervised domain adaptation with imputation
Motivated by practical applications, we consider unsupervised domain adaptation for classification problems, in the presence of missing data in the target domain. More precisely, we focus on the case where there is a dom…
ClassificationDomain AdaptationImputationUnsupervised Domain Adaptation