paper-with-me

Papers

Differential Privacy for Sparse Classification Learning

2019-08-02 · Puyu Wang, Hai Zhang

In this paper, we present a differential privacy version of convex and nonconvex sparse classification approach. Based on alternating direction method of multiplier (ADMM) algorithm, we transform the solving of sparse problem into the multistep iteration process. Then we add exponential noise to stable steps to achieve privacy protection. By the property of the post-processing holding of differential privacy, the proposed approach satisfies the $\epsilon-$differential privacy even when the original problem is unstable. Furthermore, we present the theoretical privacy bound of the differential privacy classification algorithm. Specifically, the privacy bound of our algorithm is controlled by the algorithm iteration number, the privacy parameter, the parameter of loss function, ADMM pre-selected parameter, and the data size. Finally we apply our framework to logistic regression with $L_1$ regularizer and logistic regression with $L_{1/2}$ regularizer. Numerical studies demonstrate that our method is both effective and efficient which performs well in sensitive data analysis.

📄 PDF Abstract BibTeX arXiv:1908.00780

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classificationregression

Methods 이 논문이 사용한 방법론

Logistic Regression Logistic Regression, despite its name, is a linear model for classification rather than regression. Logistic regression is also known in the literature as logit regression,…
ADMM The alternating direction method of multipliers (ADMM) is an algorithm that solves convex optimization problems by breaking them into smaller pieces, each of which are…

Similar Papers 제목 키워드 기반

Differentially Private Regression and Classification with Sparse Gaussian Processes

2019-09-19 · Michael Thomas Smith, Mauricio A. Alvarez, Neil D. Lawrence

A continuing challenge for machine learning is providing methods to perform computation on data while ensuring the data remains private. In this paper we build on the provable privacy guarantees of differential privacy w…

ClassificationGaussian ProcessesGeneral Classificationregression

Differentially Private High Dimensional Bandits

2024-02-06 · Apurv Shukla

We consider a high-dimensional stochastic contextual linear bandit problem when the parameter vector is $s_{0}$-sparse and the decision maker is subject to privacy constraints under both central and local models of diffe…

Smooth Anonymity for Sparse Graphs

2022-07-13 · Alessandro Epasto, Hossein Esfandiari, Vahab Mirrokni, Andres Munoz Medina

When working with user data providing well-defined privacy guarantees is paramount. In this work, we aim to manipulate and share an entire sparse dataset with a third party privately. In fact, differential privacy has em…

ABCDP: Approximate Bayesian Computation with Differential Privacy

2019-10-11 · Mijung Park, Margarita Vinaroz, Wittawat Jitkrittum

We develop a novel approximate Bayesian computation (ABC) framework, ABCDP, that produces differentially private (DP) and approximate posterior samples. Our framework takes advantage of the Sparse Vector Technique (SVT),…

Privacy Preserving

Improving Sparse Vector Technique with Renyi Differential Privacy

2020-12-01 · NeurIPS 2020 12 · Yuqing Zhu, Yu-Xiang Wang

The Sparse Vector Technique (SVT) is one of the most fundamental algorithmic tools in differential privacy (DP). It also plays a central role in the state-of-the-art algorithms for adaptive data analysis and model-agnost…