Source-free Domain Adaptation via Distributional Alignment by Matching Batch Normalization Statistics
In this paper, we propose a novel domain adaptation method for the source-free setting. In this setting, we cannot access source data during adaptation, while unlabeled target data and a model pretrained with source data are given. Due to lack of source data, we cannot directly match the data distributions between domains unlike typical domain adaptation algorithms. To cope with this problem, we propose utilizing batch normalization statistics stored in the pretrained model to approximate the distribution of unobserved source data. Specifically, we fix the classifier part of the model during adaptation and only fine-tune the remaining feature encoder part so that batch normalization statistics of the features extracted by the encoder match those stored in the fixed classifier. Additionally, we also maximize the mutual information between the features and the classifier's outputs to further boost the classification performance. Experimental results with several benchmark datasets show that our method achieves competitive performance with state-of-the-art domain adaptation methods even though it does not require access to source data.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationSource-Free Domain AdaptationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
SFDA-rPPG: Source-Free Domain Adaptive Remote Physiological Measurement with Spatio-Temporal Consistency
Remote Photoplethysmography (rPPG) is a non-contact method that uses facial video to predict changes in blood volume, enabling physiological metrics measurement. Traditional rPPG models often struggle with poor generaliz…
Domain AdaptationDomain GeneralizationSource-Free Domain AdaptationMulti-Source Unsupervised Domain Adaptation with Prototype Aggregation
Multi-source domain adaptation (MSDA) plays an important role in industrial model generalization. Recent efforts on MSDA focus on enhancing multi-domain distributional alignment while omitting three issues, e.g., the cla…
Domain AdaptationMulti-Source Unsupervised Domain AdaptationPseudo LabelUnsupervised Domain AdaptationTemporal-Spectral Alignment with Frequency Adaptation for Source-Free Time-Series Adaptation
The goal of source-free domain adaptation (SFDA) for time-series data is to transfer knowledge from a pre-trained source model to an unlabeled target domain without requiring access to source data, while addressing featu…
Source-Free Domain AdaptationFedSCAl: Leveraging Server and Client Alignment for Unsupervised Federated Source-Free Domain Adaptation
We address the Federated source-Free Domain Adaptation (FFreeDA) problem, with clients holding unlabeled data with significant inter-client domain gaps. The FFreeDA setup constrains the FL frameworks to employ only a pre…
Source-Free Domain AdaptationUncertainty-Guided Mixup for Semi-Supervised Domain Adaptation without Source Data
Present domain adaptation methods usually perform explicit representation alignment by simultaneously accessing the source data and target data. However, the source data are not always available due to the privacy preser…
Domain AdaptationPrivacy PreservingSemi-supervised Domain AdaptationSource-Free Domain Adaptation