Model Explanations with Differential Privacy
Black-box machine learning models are used in critical decision-making domains, giving rise to several calls for more algorithmic transparency. The drawback is that model explanations can leak information about the training data and the explanation data used to generate them, thus undermining data privacy. To address this issue, we propose differentially private algorithms to construct feature-based model explanations. We design an adaptive differentially private gradient descent algorithm, that finds the minimal privacy budget required to produce accurate explanations. It reduces the overall privacy loss on explanation data, by adaptively reusing past differentially private explanations. It also amplifies the privacy guarantees with respect to the training data. We evaluate the implications of differentially private models and our privacy mechanisms on the quality of model explanations.
Code (0)
등록된 구현이 없습니다.
Tasks
Decision MakingmodelSimilar Papers 제목 키워드 기반
Contrastive Explainable Clustering with Differential Privacy
This paper presents a novel approach to Explainable AI (XAI) that combines contrastive explanations with differential privacy for clustering algorithms. Focusing on k-median and k-means problems, we calculate contrastive…
ClusteringPrivacy PreservingReconXF: Graph Reconstruction Attack via Public Feature Explanations on Privatized Node Features and Labels
Graph Neural Networks (GNNs) achieve high performance across many applications but function as black-box models, limiting their use in critical domains like healthcare and criminal justice. Explainability methods address…
DenoisingGraph ReconstructionReconstruction AttackExplanations Leak: Membership Inference with Differential Privacy and Active Learning Defense
Counterfactual explanations (CFs) are increasingly integrated into Machine Learning as a Service (MLaaS) systems to improve transparency; however, ML models deployed via APIs are already vulnerable to privacy attacks suc…
Model extractionActive LearningConsiderations on the Theory of Training Models with Differential Privacy
In federated learning collaborative learning takes place by a set of clients who each want to remain in control of how their local training data is used, in particular, how can each client's local training data remain pr…
Federated LearningDifferential Privacy for Anomaly Detection: Analyzing the Trade-off Between Privacy and Explainability
Anomaly detection (AD), also referred to as outlier detection, is a statistical process aimed at identifying observations within a dataset that significantly deviate from the expected pattern of the majority of the data.…
Anomaly DetectionOutlier Detection