paper-with-me

홈 › Papers

Differentially Private Multi-Sampling from Distributions

2024-12-13 · Albert Cheu, Debanuj Nayak

Many algorithms have been developed to estimate probability distributions subject to differential privacy (DP): such an algorithm takes as input independent samples from a distribution and estimates the density function in a way that is insensitive to any one sample. A recent line of work, initiated by Raskhodnikova et al. (Neurips '21), explores a weaker objective: a differentially private algorithm that approximates a single sample from the distribution. Raskhodnikova et al. studied the sample complexity of DP \emph{single-sampling} i.e., the minimum number of samples needed to perform this task. They showed that the sample complexity of DP single-sampling is less than the sample complexity of DP learning for certain distribution classes. We define two variants of \emph{multi-sampling}, where the goal is to privately approximate $m>1$ samples. This better models the realistic scenario where synthetic data is needed for exploratory data analysis. A baseline solution to \emph{multi-sampling} is to invoke a single-sampling algorithm $m$ times on independently drawn datasets of samples. When the data comes from a finite domain, we improve over the baseline by a factor of $m$ in the sample complexity. When the data comes from a Gaussian, Ghazi et al. (Neurips '23) show that \emph{single-sampling} can be performed under approximate differential privacy; we show it is possible to \emph{single- and multi-sample Gaussians with known covariance subject to pure DP}. Our solution uses a variant of the Laplace mechanism that is of independent interest. We also give sample complexity lower bounds, one for strong multi-sampling of finite distributions and another for weak multi-sampling of bounded-covariance Gaussians.

📄 PDF Abstract BibTeX arXiv:2412.10512

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Differentially Private Sampling from Distributions

2022-11-15 · NeurIPS 2021 12 · Sofya Raskhodnikova, Satchit Sivakumar, Adam Smith, Marika Swanberg

We initiate an investigation of private sampling from distributions. Given a dataset with $n$ independent observations from an unknown distribution $P$, a sampling algorithm must output a single observation from a distri…

Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptions

2025-11-03 · Tomer Shoham, Moshe Shenfeld, Noa Velner-Harris, Katrina Ligett arxiv

We consider the problem of constructing differentially private nonparametric confidence intervals (CIs) for an arbitrary quantity using resampling. A growing body of work has adapted resampling ideas to the private setti…

Exactly Minimax-Optimal Locally Differentially Private Sampling

2024-10-30 · Hyun-Young Park, Shahab Asoodeh, Si-Hyeon Lee

The sampling problem under local differential privacy has recently been studied with potential applications to generative models, but a fundamental analysis of its privacy-utility trade-off (PUT) remains incomplete. In t…

Optimal Differentially Private Sampling of Unbounded Gaussians

2025-03-03 · Valentio Iverson, Gautam Kamath, Argyris Mouzakis

We provide the first $\widetilde{\mathcal{O}}\left(d\right)$-sample algorithm for sampling from unbounded Gaussian distributions under the constraint of $\left(\varepsilon, \delta\right)$-differential privacy. This is a …

Differentially Private Statistical Inference through $\beta$-Divergence One Posterior Sampling

2023-09-21 · NeurIPS 2023 11

Differential privacy guarantees allow the results of a statistical analysis involving sensitive data to be released without compromising the privacy of any individual taking part. Achieving such guarantees generally requ…