A Privacy-Preserving Unsupervised Domain Adaptation Framework for Clinical Text Analysis
Unsupervised domain adaptation (UDA) generally aligns the unlabeled target domain data to the distribution of the source domain to mitigate the distribution shift problem. The standard UDA requires sharing the source data with the target, having potential data privacy leaking risks. To protect the source data's privacy, we first propose to share the source feature distribution instead of the source data. However, sharing only the source feature distribution may still suffer from the membership inference attack who can infer an individual's membership by the black-box access to the source model. To resolve this privacy issue, we further study the under-explored problem of privacy-preserving domain adaptation and propose a method with a novel differential privacy training strategy to protect the source data privacy. We model the source feature distribution by Gaussian Mixture Models (GMMs) under the differential privacy setting and send it to the target client for adaptation. The target client resamples differentially private source features from GMMs and adapts on target data with several state-of-art UDA backbones. With our proposed method, the source data provider could avoid leaking source data privacy during domain adaptation as well as reserve the utility. To evaluate our proposed method's utility and privacy loss, we apply our model on a medical report disease label classification task using two noisy challenging clinical text datasets. The results show that our proposed method can preserve source data's privacy with a minor performance influence on the text classification task.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationInference AttackMembership Inference AttackPrivacy Preservingtext-classificationText ClassificationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Privacy Preserving Federated Unsupervised Domain Adaptation with Application to Age Prediction from DNA Methylation Data
In computational biology, predictive models are widely used to address complex tasks, but their performance can suffer greatly when applied to data from different distributions. The current state-of-the-art domain adapta…
Domain AdaptationGaussian ProcessesPrivacy PreservingUnsupervised Domain AdaptationMulti-Step Decentralized Domain Adaptation
Despite the recent breakthroughs in unsupervised domain adaptation (uDA), no prior work has studied the challenges of applying these methods in practical machine learning scenarios. In this paper, we highlight two signif…
Domain AdaptationPrivacy PreservingUnsupervised Domain AdaptationUnsupervised Model Personalization while Preserving Privacy and Scalability: An Open Problem
This work investigates the task of unsupervised model personalization, adapted to continually evolving, unlabeled local user images. We consider the practical scenario where a high capacity server interacts with a myriad…
Continual LearningDomain AdaptationIncremental LearningScene RecognitionKD3A: Unsupervised Multi-Source Decentralized Domain Adaptation via Knowledge Distillation
Conventional unsupervised multi-source domain adaptation (UMDA) methods assume all source domains can be accessed directly. This neglects the privacy-preserving policy, that is, all the data and computations must be kept…
Domain AdaptationKnowledge DistillationMulti-Source Unsupervised Domain AdaptationPrivacy Preserving+1Towards Privacy-Supporting Fall Detection via Deep Unsupervised RGB2Depth Adaptation
Fall detection is a vital task in health monitoring, as it allows the system to trigger an alert and therefore enabling faster interventions when a person experiences a fall. Although most previous approaches rely on sta…
Domain AdaptationTriplet