On the Theory and Practice of Privacy-Preserving Bayesian Data Analysis
Bayesian inference has great promise for the privacy-preserving analysis of sensitive data, as posterior sampling automatically preserves differential privacy, an algorithmic notion of data privacy, under certain conditions (Dimitrakakis et al., 2014; Wang et al., 2015). While this one posterior sample (OPS) approach elegantly provides privacy "for free," it is data inefficient in the sense of asymptotic relative efficiency (ARE). We show that a simple alternative based on the Laplace mechanism, the workhorse of differential privacy, is as asymptotically efficient as non-private posterior inference, under general assumptions. This technique also has practical advantages including efficient use of the privacy budget for MCMC. We demonstrate the practicality of our approach on a time-series analysis of sensitive military records from the Afghanistan and Iraq wars disclosed by the Wikileaks organization.
Code (0)
등록된 구현이 없습니다.
Tasks
Bayesian InferencePrivacy PreservingTime SeriesTime Series AnalysisSimilar Papers 제목 키워드 기반
Federated Deep Learning with Bayesian Privacy
Federated learning (FL) aims to protect data privacy by cooperatively learning a model without sharing private data among users. For Federated Learning of Deep Neural Network with billions of model parameters, existing p…
Deep LearningFederated Learningimage-classificationImage Classification+1Differential Privacy Overview and Fundamental Techniques
This chapter is meant to be part of the book "Differential Privacy in Artificial Intelligence: From Theory to Practice" and provides an introduction to Differential Privacy. It starts by illustrating various attempts to …
Privacy PreservingBridging Privacy and Robustness for Trustworthy Machine Learning
The advent of machine learning has led to transformative changes across various domains, but the sensitive nature of data raises concerns about privacy and security. While Local Differential Privacy (LDP) has been a corn…
Bayesian InferencePrivacy PreservingPractical Framework for Privacy-Preserving and Byzantine-robust Federated Learning
Federated Learning (FL) allows multiple clients to collaboratively train a model without sharing their private data. However, FL is vulnerable to Byzantine attacks, where adversaries manipulate client models to compromis…
Dimensionality ReductionFederated LearningBayesian Estimation of Differential Privacy
Algorithms such as Differentially Private SGD enable training machine learning models with formal privacy guarantees. However, there is a discrepancy between the protection that such algorithms guarantee in theory and th…