paper-with-me

Papers

Better Locally Private Sparse Estimation Given Multiple Samples Per User

2024-08-08 · Yuheng Ma, Ke Jia, Hanfang Yang

Previous studies yielded discouraging results for item-level locally differentially private linear regression with $s^*$-sparsity assumption, where the minimax rate for $nm$ samples is $\mathcal{O}(s^{*}d / nm\varepsilon^2)$. This can be challenging for high-dimensional data, where the dimension $d$ is extremely large. In this work, we investigate user-level locally differentially private sparse linear regression. We show that with $n$ users each contributing $m$ samples, the linear dependency of dimension $d$ can be eliminated, yielding an error upper bound of $\mathcal{O}(s^{*2} / nm\varepsilon^2)$. We propose a framework that first selects candidate variables and then conducts estimation in the narrowed low-dimensional space, which is extendable to general sparse estimation problems with tight error bounds. Experiments on both synthetic and real datasets demonstrate the superiority of the proposed methods. Both the theoretical and empirical results suggest that, with the same number of samples, locally private sparse estimation is better conducted when multiple samples per user are available.

📄 PDF Abstract BibTeX arXiv:2408.04313

Code (1)

karlmyh/uldp-sl 공식 구현

Tasks

regression

Methods 이 논문이 사용한 방법론

Linear Regression Linear Regression is a method for modelling a relationship between a dependent variable and independent variables. These models can be fit with numerous approaches. The most…

Similar Papers 제목 키워드 기반

Locally Private Gaussian Estimation

2018-11-20 · NeurIPS 2019 12 · Matthew Joseph, Janardhan Kulkarni, Jieming Mao, Zhiwei Steven Wu

We study a basic private estimation problem: each of $n$ users draws a single i.i.d. sample from an unknown Gaussian distribution, and the goal is to estimate the mean of this Gaussian distribution while satisfying local…

Contraction of Locally Differentially Private Mechanisms

2022-10-24 · Shahab Asoodeh, Huanyu Zhang

We investigate the contraction properties of locally differentially private mechanisms. More specifically, we derive tight upper bounds on the divergence between $PK$ and $QK$ output distributions of an $\epsilon$-LDP me…

Density Estimation

Instance-Optimal Differentially Private Estimation

2022-10-28 · Audra McMillan, Adam Smith, Jon Ullman

In this work, we study local minimax convergence estimation rates subject to $\epsilon$-differential privacy. Unlike worst-case rates, which may be conservative, algorithms that are locally minimax optimal must adapt to …

Decision Tree for Locally Private Estimation with Public Data

2023-09-21 · NeurIPS 2023 11

We propose conducting locally differentially private (LDP) estimation with the aid of a small amount of public data to enhance the performance of private estimation. Specifically, we introduce an efficient algorithm call…

Locally Private Bayesian Inference for Count Models

2018-03-22 · Aaron Schein, Zhiwei Steven Wu, Alexandra Schofield, Mingyuan Zhou 외

We present a general method for privacy-preserving Bayesian inference in Poisson factorization, a broad class of models that includes some of the most widely used models in the social sciences. Our method satisfies limit…

Bayesian InferenceLink PredictionPrivacy Preserving