paper-with-me

홈 › Papers

Bayesian Differential Privacy through Posterior Sampling

2013-06-05 · Christos Dimitrakakis, Blaine Nelson, and Zuhe Zhang, Aikaterini Mitrokotsa, Benjamin Rubinstein

Differential privacy formalises privacy-preserving mechanisms that provide access to a database. We pose the question of whether Bayesian inference itself can be used directly to provide private access to data, with no modification. The answer is affirmative: under certain conditions on the prior, sampling from the posterior distribution can be used to achieve a desired level of privacy and utility. To do so, we generalise differential privacy to arbitrary dataset metrics, outcome spaces and distribution families. This allows us to also deal with non-i.i.d or non-tabular datasets. We prove bounds on the sensitivity of the posterior to the data, which gives a measure of robustness. We also show how to use posterior sampling to provide differentially private responses to queries, within a decision-theoretic framework. Finally, we provide bounds on the utility and on the distinguishability of datasets. The latter are complemented by a novel use of Le Cam's method to obtain lower bounds. All our general results hold for arbitrary database metrics, including those for the common definition of differential privacy. For specific choices of the metric, we give a number of examples satisfying our assumptions.

📄 PDF Abstract BibTeX arXiv:1306.1066

Code (0)

등록된 구현이 없습니다.

Tasks

Bayesian InferencePrivacy Preserving

Similar Papers 제목 키워드 기반

DP-IVON-Gradsq: Differentially Private Squared-Gradient Improved Variational Online Newton

2026-07-26 · Nour Jamoussi, Ikram Dridi, Giuseppe Serra, Marios Kountouris arxiv

Differential privacy provides formal privacy guarantees for training neural networks on sensitive data, while Bayesian deep learning offers a principled framework for uncertainty-aware prediction. Combining these two obj…

Computational Efficiency

Can Stochastic Gradient Langevin Dynamics Provide Differential Privacy for Deep Learning?

2021-10-11 · Guy Heller, Ethan Fetaya

Bayesian learning via Stochastic Gradient Langevin Dynamics (SGLD) has been suggested for differentially private learning. While previous research provides differential privacy bounds for SGLD at the initial steps of the…

Privacy for Free: Posterior Sampling and Stochastic Gradient Monte Carlo

2015-02-26 · Yu-Xiang Wang, Stephen E. Fienberg, Alex Smola

We consider the problem of Bayesian learning on sensitive datasets and present two simple but somewhat surprising results that connect Bayesian learning to "differential privacy:, a cryptographic approach to protect indi…

On the Differential Privacy of Bayesian Inference

2015-12-22 · Zuhe Zhang, Benjamin Rubinstein, Christos Dimitrakakis

We study how to communicate findings of Bayesian inference to third parties, while preserving the strong guarantee of differential privacy. Our main contributions are four different algorithms for private Bayesian infere…

Bayesian Inference

On the Theory and Practice of Privacy-Preserving Bayesian Data Analysis

2016-03-23 · James Foulds, Joseph Geumlek, Max Welling, Kamalika Chaudhuri

Bayesian inference has great promise for the privacy-preserving analysis of sensitive data, as posterior sampling automatically preserves differential privacy, an algorithmic notion of data privacy, under certain conditi…

Bayesian InferencePrivacy PreservingTime SeriesTime Series Analysis