Towards Accurate Model Selection in Deep Unsupervised Domain Adaptation
Deep unsupervised domain adaptation (Deep UDA) methods successfully leverage rich labeled data in a source domain to boost the performance on related but unlabeled data in a target domain. However, algorithm comparison is cumbersome in Deep UDA due to the absence of accurate and standardized model selection method, posing an obstacle to further advances in the field. Existing model selection methods for Deep UDA are either highly biased, restricted, unstable, or even controversial (requiring labeled target data). To this end, we propose Deep Embedded Validation (DEV), which embeds adapted feature representation into the validation procedure to obtain unbiased estimation of the target risk with bounded variance. The variance is further reduced by the technique of control variate. The efficacy of the method has been justified both theoretically and empirically.
Code (2)
Tasks
Domain AdaptationModel SelectionUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Towards Accurate Model Selection in Deep Unsupervised Domain Adaptation
Deep unsupervised domain adaptation (Deep UDA) methods successfully leverage rich labeled data in a source domain to boost the performance on related but unlabeled data in a target domain. However, algorithm comparison i…
Unsupervised Domain AdaptationIW-GAE: Importance Weighted Group Accuracy Estimation for Improved Calibration and Model Selection in Unsupervised Domain Adaptation
Distribution shifts pose significant challenges for model calibration and model selection tasks in the unsupervised domain adaptation problem -- a scenario where the goal is to perform well in a distribution shifted doma…
Domain AdaptationModel SelectionUnsupervised Domain AdaptationScaling Unsupervised Domain Adaptation through Optimal Collaborator Selection and Lazy Discriminator Synchronization
Breakthroughs in unsupervised domain adaptation (uDA) have opened up the possibility of adapting models from a label-rich source domain to unlabeled target domains. Prior uDA works have primarily focused on improving ada…
Domain AdaptationPrivacy PreservingUnsupervised Domain AdaptationLabeling Where Adapting Fails: Cross-Domain Semantic Segmentation with Point Supervision via Active Selection
Training models dedicated to semantic segmentation requires a large amount of pixel-wise annotated data. Due to their costly nature, these annotations might not be available for the task at hand. To alleviate this proble…
Domain AdaptationSemantic SegmentationUnsupervised Domain AdaptationMixed Samples as Probes for Unsupervised Model Selection in Domain Adaptation
Unsupervised domain adaptation (UDA) has been widely applied in improving model generalization on unlabeled target data. However, accurately selecting the best UDA model for the target domain is challenging due to the ab…