Preserving Domain Private Representation via Mutual Information Maximization
Recent advances in unsupervised domain adaptation have shown that mitigating the domain divergence by extracting the domain-invariant representation could significantly improve the generalization of a model to an unlabeled data domain. Nevertheless, the existing methods fail to effectively preserve the representation that is private to the label-missing domain, which could adversely affect the generalization. In this paper, we propose an approach to preserve such representation so that the latent distribution of the unlabeled domain could represent both the domain-invariant features and the individual characteristics that are private to the unlabeled domain. In particular, we demonstrate that maximizing the mutual information between the unlabeled domain and its latent space while mitigating the domain divergence can achieve such preservation. We also theoretically and empirically validate that preserving the representation that is private to the unlabeled domain is important and of necessity for the cross-domain generalization. Our approach outperforms state-of-the-art methods on several public datasets.
Code (0)
등록된 구현이 없습니다.
Tasks
Domain AdaptationDomain GeneralizationUnsupervised Domain AdaptationSimilar Papers 제목 키워드 기반
Privacy-Preserving Representation Learning on Graphs: A Mutual Information Perspective
Learning with graphs has attracted significant attention recently. Existing representation learning methods on graphs have achieved state-of-the-art performance on various graph-related tasks such as node classification,…
Link PredictionNode ClassificationPrivacy PreservingRepresentation LearningBest-First Width Search for Multi Agent Privacy-preserving Planning
In multi-agent planning, preserving the agents' privacy has become an increasingly popular research topic. For preserving the agents' privacy, agents jointly compute a plan that achieves mutual goals by keeping certain i…
Privacy PreservingDistributed generation of privacy preserving data with user customization
Distributed devices such as mobile phones can produce and store large amounts of data that can enhance machine learning models; however, this data may contain private information specific to the data owner that prevents …
Privacy Preserving$α$-Mutual Information: A Tunable Privacy Measure for Privacy Protection in Data Sharing
This paper adopts Arimoto's $\alpha$-Mutual Information as a tunable privacy measure, in a privacy-preserving data release setting that aims to prevent disclosing private data to adversaries. By fine-tuning the privacy m…
Privacy PreservingTime SeriesPrivacy-Preserving Anomaly Detection in Stochastic Dynamical Systems: Synthesis of Optimal Gaussian Mechanisms
We present a framework for designing distorting mechanisms that allow remotely operating anomaly detectors while preserving privacy. We consider the problem setting in which a remote station seeks to identify anomalies u…
Anomaly DetectionPrivacy Preserving