Label Calibration in Source Free Domain Adaptation
Source-free domain adaptation (SFDA) utilizes a pre-trained source model with unlabeled target data. Self-supervised SFDA techniques generate pseudolabels from the pre-trained source model, but these pseudolabels often contain noise due to domain discrepancies between the source and target domains. Traditional self-supervised SFDA techniques rely on deterministic model predictions using the softmax function, leading to unreliable pseudolabels. In this work, we propose to introduce predictive uncertainty and softmax calibration for pseudolabel refinement using evidential deep learning. The Dirichlet prior is placed over the output of the target network to capture uncertainty using evidence with a single forward pass. Furthermore, softmax calibration solves the translation invariance problem to assist in learning with noisy labels. We incorporate a combination of evidential deep learning loss and information maximization loss with calibrated softmax in both prior and non-prior target knowledge SFDA settings. Extensive experimental analysis shows that our method outperforms other state-of-the-art methods on benchmark datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Deep LearningDomain AdaptationLearning with noisy labelsSource-Free Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
PseudoCal: A Source-Free Approach to Unsupervised Uncertainty Calibration in Domain Adaptation
Unsupervised domain adaptation (UDA) has witnessed remarkable advancements in improving the accuracy of models for unlabeled target domains. However, the calibration of predictive uncertainty in the target domain, a cruc…
Domain AdaptationUnsupervised Domain AdaptationCal-SFDA: Source-Free Domain-adaptive Semantic Segmentation with Differentiable Expected Calibration Error
The prevalence of domain adaptive semantic segmentation has prompted concerns regarding source domain data leakage, where private information from the source domain could inadvertently be exposed in the target domain. To…
Domain AdaptationModel SelectionPseudo LabelSemantic Segmentation+1COCA: Classifier-Oriented Calibration via Textual Prototype for Source-Free Universal Domain Adaptation
Universal domain adaptation (UniDA) aims to address domain and category shifts across data sources. Recently, due to more stringent data restrictions, researchers have introduced source-free UniDA (SF-UniDA). SF-UniDA me…
Domain AdaptationFew-Shot LearningLanguage ModellingUniversal Domain AdaptationSource-Free Adaptation to Measurement Shift via Bottom-Up Feature Restoration
Source-free domain adaptation (SFDA) aims to adapt a model trained on labelled data in a source domain to unlabelled data in a target domain without access to the source-domain data during adaptation. Existing methods fo…
Domain AdaptationSource-Free Domain AdaptationTransferable Calibration with Lower Bias and Variance in Domain Adaptation
Domain Adaptation (DA) enables transferring a learning machine from a labeled source domain to an unlabeled target one. While remarkable advances have been made, most of the existing DA methods focus on improving the tar…
Decision MakingDomain Adaptation