SSDA: Secure Source-Free Domain Adaptation
Source-free domain adaptation (SFDA) is a popular unsupervised domain adaptation method where a pre-trained model from a source domain is adapted to a target domain without accessing any source data. Despite rich results in this area, existing literature overlooks the security challenges of the unsupervised SFDA setting in presence of a malicious source domain owner. This work investigates the effect of a source adversary which may inject a hidden malicious behavior (Backdoor/Trojan) during source training and potentially transfer it to the target domain even after benign training by the victim (target domain owner). Our investigation of the current SFDA setting reveals that because of the unique challenges present in SFDA (e.g., no source data, target label), defending against backdoor attack using existing defenses become practically ineffective in protecting the target model. To address this, we propose a novel target domain protection scheme called secure source-free domain adaptation (SSDA). SSDA adopts a single-shot model compression of a pre-trained source model and a novel knowledge transfer scheme with a spectral-norm-based loss penalty for target training. The proposed static compression and the dynamic training loss penalty are designed to suppress the malicious channels responsive to the backdoor during the adaptation stage. At the same time, the knowledge transfer from an uncompressed auxiliary model helps to recover the benign test accuracy. Our extensive evaluation on multiple dataset and domain tasks against recent backdoor attacks reveal that the proposed SSDA can successfully defend against strong backdoor attacks with little to no degradation in test accuracy compared to the vulnerable baseline SFDA methods. Our code is available at https://github.com/ML-Security-Research-LAB/SSDA.
Code (1)
Tasks
Backdoor AttackDomain AdaptationModel CompressionSource-Free Domain AdaptationTransfer LearningUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Knowledge-Data Fusion Based Source-Free Semi-Supervised Domain Adaptation for Seizure Subtype Classification
Electroencephalogram (EEG)-based seizure subtype classification enhances clinical diagnosis efficiency. Source-free semi-supervised domain adaptation (SF-SSDA), which transfers a pre-trained model to a new dataset with n…
ClassificationDomain AdaptationEEGElectroencephalogram (EEG)+4Semi-Supervised Transfer Boosting (SS-TrBoosting)
Semi-supervised domain adaptation (SSDA) aims at training a high-performance model for a target domain using few labeled target data, many unlabeled target data, and plenty of auxiliary data from a source domain. Previou…
Domain AdaptationSemi-supervised Domain AdaptationSource-Free Domain AdaptationUnsupervised Domain AdaptationUniversal Semi-Supervised Domain Adaptation by Mitigating Common-Class Bias
Domain adaptation is a critical task in machine learning that aims to improve model performance on a target domain by leveraging knowledge from a related source domain. In this work, we introduce Universal Semi-Supervise…
Domain AdaptationPseudo LabelSemi-supervised Domain AdaptationUniversal Domain AdaptationFederated Semi-Supervised Domain Adaptation via Knowledge Transfer
Given the rapidly changing machine learning environments and expensive data labeling, semi-supervised domain adaptation (SSDA) is imperative when the labeled data from the source domain is statistically different from th…
Domain AdaptationFederated LearningKnowledge DistillationSemi-supervised Domain Adaptation+1Semi-Supervised Domain Adaptation with Source Label Adaptation
Semi-Supervised Domain Adaptation (SSDA) involves learning to classify unseen target data with a few labeled and lots of unlabeled target data, along with many labeled source data from a related domain. Current SSDA appr…
Domain AdaptationPseudo LabelSemi-supervised Domain Adaptation