paper-with-me

홈 › Papers

Empirical Risk Minimization in Non-interactive Local Differential Privacy Revisited

2018-12-01 · NeurIPS 2018 12 · Di Wang, Marco Gaboardi, Jinhui Xu

In this paper, we revisit the Empirical Risk Minimization problem in the non-interactive local model of differential privacy. In the case of constant or low dimensions ($p\ll n$), we first show that if the loss function is $(\infty, T)$-smooth, we can avoid a dependence of the sample complexity, to achieve error $\alpha$, on the exponential of the dimensionality $p$ with base $1/\alpha$ ({\em i.e.,} $\alpha^{-p}$), which answers a question in \cite{smith2017interaction}. Our approach is based on polynomial approximation. Then, we propose player-efficient algorithms with $1$-bit communication complexity and $O(1)$ computation cost for each player. The error bound is asymptotically the same as the original one. With some additional assumptions, we also give an efficient algorithm for the server. In the case of high dimensions ($n\ll p$), we show that if the loss function is a convex generalized linear function, the error can be bounded by using the Gaussian width of the constrained set, instead of $p$, which improves the one in \cite{smith2017interaction}.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Empirical Risk Minimization in Non-interactive Local Differential Privacy: Efficiency and High Dimensional Case

2018-02-12 · NeurIPS 2018 · Di Wang, Marco Gaboardi, Jinhui Xu

In this paper, we study the Empirical Risk Minimization problem in the non-interactive local model of differential privacy. In the case of constant or low dimensionality ($p\ll n$), we first show that if the ERM loss fun…

Empirical Risk Minimization in the Non-interactive Local Model of Differential Privacy

2020-11-11 · Di Wang, Marco Gaboardi, Adam Smith, Jinhui Xu

In this paper, we study the Empirical Risk Minimization (ERM) problem in the non-interactive Local Differential Privacy (LDP) model. Previous research on this problem \citep{smith2017interaction} indicates that the sampl…

Differentially Private ADMM for Convex Distributed Learning: Improved Accuracy via Multi-Step Approximation

2020-05-16 · Zonghao Huang, Yanmin Gong

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation …

Private Non-smooth Empirical Risk Minimization and Stochastic Convex Optimization in Subquadratic Steps

2021-03-29 · Janardhan Kulkarni, Yin Tat Lee, Daogao Liu

We study the differentially private Empirical Risk Minimization (ERM) and Stochastic Convex Optimization (SCO) problems for non-smooth convex functions. We get a (nearly) optimal bound on the excess empirical risk and ex…

Differentially Private Empirical Risk Minimization with Sparsity-Inducing Norms

2019-05-13 · K. S. Sesh Kumar, Marc Peter Deisenroth

Differential privacy is concerned about the prediction quality while measuring the privacy impact on individuals whose information is contained in the data. We consider differentially private risk minimization problems w…