Provably Uncertainty-Guided Universal Domain Adaptation
Universal domain adaptation (UniDA) aims to transfer the knowledge from a labeled source domain to an unlabeled target domain without any assumptions of the label sets, which requires distinguishing the unknown samples from the known ones in the target domain. A main challenge of UniDA is that the nonidentical label sets cause the misalignment between the two domains. Moreover, the domain discrepancy and the supervised objectives in the source domain easily lead the whole model to be biased towards the common classes and produce overconfident predictions for unknown samples. To address the above challenging problems, we propose a new uncertainty-guided UniDA framework. Firstly, we introduce an empirical estimation of the probability of a target sample belonging to the unknown class which fully exploits the distribution of the target samples in the latent space. Then, based on the estimation, we propose a novel neighbors searching scheme in a linear subspace with a $\delta$-filter to estimate the uncertainty score of a target sample and discover unknown samples. It fully utilizes the relationship between a target sample and its neighbors in the source domain to avoid the influence of domain misalignment. Secondly, this paper well balances the confidences of predictions for both known and unknown samples through an uncertainty-guided margin loss based on the confidences of discovered unknown samples, which can reduce the gap between the intra-class variances of known classes with respect to the unknown class. Finally, experiments on three public datasets demonstrate that our method significantly outperforms existing state-of-the-art methods.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationUniversal Domain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Connecting sufficient conditions for domain adaptation: source-guided uncertainty, relaxed divergences and discrepancy localization
Recent advances in domain adaptation establish that requiring a low risk on the source domain and equal feature marginals degrade the adaptation's performance. At the same time, empirical evidence shows that incorporatin…
Domain AdaptationGeometric Anchor Correspondence Mining With Uncertainty Modeling for Universal Domain Adaptation
Universal domain adaptation (UniDA) aims to transfer the knowledge learned from a label-rich source domain to a label-scarce target domain without any constraints on the label space. However, domain shift and categor…
Contrastive LearningDomain AdaptationUniversal Domain AdaptationMedSAM-U: Uncertainty-Guided Auto Multi-Prompt Adaptation for Reliable MedSAM
The Medical Segment Anything Model (MedSAM) has shown remarkable performance in medical image segmentation, drawing significant attention in the field. However, its sensitivity to varying prompt types and locations poses…
Image SegmentationMedical Image SegmentationSegmentationSemantic SegmentationUniversal Semi-Supervised Domain Adaptation by Mitigating Common-Class Bias
Domain adaptation is a critical task in machine learning that aims to improve model performance on a target domain by leveraging knowledge from a related source domain. In this work, we introduce Universal Semi-Supervise…
Domain AdaptationPseudo LabelSemi-supervised Domain AdaptationUniversal Domain AdaptationUncertainty-Guided Alignment for Unsupervised Domain Adaptation in Regression
Unsupervised Domain Adaptation for Regression (UDAR) aims to adapt models from a labeled source domain to an unlabeled target domain for regression tasks. Traditional feature alignment methods, successful in classificati…
Domain AdaptationregressionUnsupervised Domain Adaptation