paper-with-me

Papers

Subset-Based Instance Optimality in Private Estimation

2023-03-01 · Travis Dick, Alex Kulesza, Ziteng Sun, Ananda Theertha Suresh

We propose a new definition of instance optimality for differentially private estimation algorithms. Our definition requires an optimal algorithm to compete, simultaneously for every dataset $D$, with the best private benchmark algorithm that (a) knows $D$ in advance and (b) is evaluated by its worst-case performance on large subsets of $D$. That is, the benchmark algorithm need not perform well when potentially extreme points are added to $D$; it only has to handle the removal of a small number of real data points that already exist. This makes our benchmark significantly stronger than those proposed in prior work. We nevertheless show, for real-valued datasets, how to construct private algorithms that achieve our notion of instance optimality when estimating a broad class of dataset properties, including means, quantiles, and $\ell_p$-norm minimizers. For means in particular, we provide a detailed analysis and show that our algorithm simultaneously matches or exceeds the asymptotic performance of existing algorithms under a range of distributional assumptions.

📄 PDF Abstract BibTeX arXiv:2303.01262

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Instance-Optimality for Private KL Distribution Estimation

2025-05-29 · Jiayuan Ye, Vitaly Feldman, Kunal Talwar

We study the fundamental problem of estimating an unknown discrete distribution $p$ over $d$ symbols, given $n$ i.i.d. samples from the distribution. We are interested in minimizing the KL divergence between the true dis…

Instance-Optimal Private Density Estimation in the Wasserstein Distance

2024-06-27 · Vitaly Feldman, Audra McMillan, Satchit Sivakumar, Kunal Talwar

Estimating the density of a distribution from samples is a fundamental problem in statistics. In many practical settings, the Wasserstein distance is an appropriate error metric for density estimation. For example, when …

Density Estimation

On Differentially Private U Statistics

2024-07-06 · Kamalika Chaudhuri, Po-Ling Loh, Shourya Pandey, Purnamrita Sarkar

We consider the problem of privately estimating a parameter $\mathbb{E}[h(X_1,\dots,X_k)]$, where $X_1$, $X_2$, $\dots$, $X_k$ are i.i.d. data from some distribution and $h$ is a permutation-invariant function. Without p…

Instance-optimality in differential privacy via approximate inverse sensitivity mechanisms

2020-12-01 · NeurIPS 2020 12 · Hilal Asi, John C. Duchi

We study and provide instance-optimal algorithms in differential privacy by extending and approximating the inverse sensitivity mechanism. We provide two approximation frameworks, one which only requires knowledge of loc…

Sensitivity

Near-Optimal Algorithms for Differentially Private Online Learning in a Stochastic Environment

2021-02-16 · Bingshan Hu, Zhiming Huang, Nishant A. Mehta, Nidhi Hegde

In this paper, we study differentially private online learning problems in a stochastic environment under both bandit and full information feedback. For differentially private stochastic bandits, we propose both UCB and …

Thompson Sampling