paper-with-me

Papers

On Differentially Private U Statistics

2024-07-06 · Kamalika Chaudhuri, Po-Ling Loh, Shourya Pandey, Purnamrita Sarkar

We consider the problem of privately estimating a parameter $\mathbb{E}[h(X_1,\dots,X_k)]$, where $X_1$, $X_2$, $\dots$, $X_k$ are i.i.d. data from some distribution and $h$ is a permutation-invariant function. Without privacy constraints, standard estimators are U-statistics, which commonly arise in a wide range of problems, including nonparametric signed rank tests, symmetry testing, uniformity testing, and subgraph counts in random networks, and can be shown to be minimum variance unbiased estimators under mild conditions. Despite the recent outpouring of interest in private mean estimation, privatizing U-statistics has received little attention. While existing private mean estimation algorithms can be applied to obtain confidence intervals, we show that they can lead to suboptimal private error, e.g., constant-factor inflation in the leading term, or even $\Theta(1/n)$ rather than $O(1/n^2)$ in degenerate settings. To remedy this, we propose a new thresholding-based approach using \emph{local H\'ajek projections} to reweight different subsets of the data. This leads to nearly optimal private error for non-degenerate U-statistics and a strong indication of near-optimality for degenerate U-statistics.

📄 PDF Abstract BibTeX arXiv:2407.04945

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

DPpack: An R Package for Differentially Private Statistical Analysis and Machine Learning

2023-09-19 · Spencer Giddens, Fang Liu

Differential privacy (DP) is the state-of-the-art framework for guaranteeing privacy for individuals when releasing aggregated statistics or building statistical/machine learning models from data. We develop the open-sou…

DescriptivePrivacy Preservingregression

Differentially private inference via noisy optimization

2021-03-19 · Marco Avella-Medina, Casey Bradshaw, Po-Ling Loh

We propose a general optimization-based framework for computing differentially private M-estimators and a new method for constructing differentially private confidence regions. Firstly, we show that robust statistics can…

Differentially Private Learning of Graphical Models using CGMs

2017-08-01 · ICML 2017 8 · Garrett Bernstein, Ryan McKenna, Tao Sun, Daniel Sheldon 외

We investigate the problem of learning discrete graphical models in a differentially private way. Approaches to this problem range from privileged algorithms that conduct learning completely behind the privacy barri…

Differentially Private Learning of Undirected Graphical Models using Collective Graphical Models

2017-06-14 · Garrett Bernstein, Ryan McKenna, Tao Sun, Daniel Sheldon 외

We investigate the problem of learning discrete, undirected graphical models in a differentially private way. We show that the approach of releasing noisy sufficient statistics using the Laplace mechanism achieves a good…

A Primer on Private Statistics

2020-04-30 · Gautam Kamath, Jonathan Ullman

Differentially private statistical estimation has seen a flurry of developments over the last several years. Study has been divided into two schools of thought, focusing on empirical statistics versus population statisti…