SF(DA)$^2$: Source-free Domain Adaptation Through the Lens of Data Augmentation
In the face of the deep learning model's vulnerability to domain shift, source-free domain adaptation (SFDA) methods have been proposed to adapt models to new, unseen target domains without requiring access to source domain data. Although the potential benefits of applying data augmentation to SFDA are attractive, several challenges arise such as the dependence on prior knowledge of class-preserving transformations and the increase in memory and computational requirements. In this paper, we propose Source-free Domain Adaptation Through the Lens of Data Augmentation (SF(DA)$^2$), a novel approach that leverages the benefits of data augmentation without suffering from these challenges. We construct an augmentation graph in the feature space of the pretrained model using the neighbor relationships between target features and propose spectral neighborhood clustering to identify partitions in the prediction space. Furthermore, we propose implicit feature augmentation and feature disentanglement as regularization loss functions that effectively utilize class semantic information within the feature space. These regularizers simulate the inclusion of an unlimited number of augmented target features into the augmentation graph while minimizing computational and memory demands. Our method shows superior adaptation performance in SFDA scenarios, including 2D image and 3D point cloud datasets and a highly imbalanced dataset.
Code (1)
Tasks
Data AugmentationDisentanglementDomain AdaptationSource-Free Domain AdaptationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Collaborate to Adapt: Source-Free Graph Domain Adaptation via Bi-directional Adaptation
Unsupervised Graph Domain Adaptation (UGDA) has emerged as a practical solution to transfer knowledge from a label-rich source graph to a completely unlabelled target graph. However, most methods require a labelled sourc…
Contrastive LearningDomain AdaptationGRAPH DOMAIN ADAPTATIONNeural Network Prediction of Strong Lensing Systems with Domain Adaptation and Uncertainty Quantification
Modeling strong gravitational lenses is computationally expensive for the complex data from modern and next-generation cosmic surveys. Deep learning has emerged as a promising approach for finding lenses and predicting l…
Domain AdaptationUncertainty QuantificationUnsupervised Domain AdaptationA3: Active Adversarial Alignment for Source-Free Domain Adaptation
Unsupervised domain adaptation (UDA) aims to transfer knowledge from a labeled source domain to an unlabeled target domain. Recent works have focused on source-free UDA, where only target data is available. This is chall…
Active LearningDomain AdaptationSelf-Supervised LearningSource-Free Domain Adaptation+1Towards Blind Lens Aberration Correction via Large LensLib Pre-training and Discrete Degradation Priors
Emerging deep-learning-based lens library pre-training (LensLib-PT) pipeline offers a new avenue for blind lens aberration correction by training a universal neural network, demonstrating strong capability in handling di…
Zero-shot GeneralizationRepresentation LearningTowards Unbiased Source-Free Object Detection via Vision Foundation Models
Source-Free Object Detection (SFOD) has garnered much attention in recent years by eliminating the need of source-domain data in cross-domain tasks, but existing SFOD methods suffer from the Source Bias problem, i.e. the…
Object Detection