paper-with-me

Papers

Practical Differentially Private Top-k Selection with Pay-what-you-get Composition

2019-12-01 · NeurIPS 2019 12 · David Durfee, Ryan M. Rogers

We study the problem of top-k selection over a large domain universe subject to user-level differential privacy. Typically, the exponential mechanism or report noisy max are the algorithms used to solve this problem. However, these algorithms require querying the database for the count of each domain element. We focus on the setting where the data domain is unknown, which is different than the setting of frequent itemsets where an apriori type algorithm can help prune the space of domain elements to query. We design algorithms that ensures (approximate) differential privacy and only needs access to the true top-k' elements from the data for any chosen k' ≥ k. This is a highly desirable feature for making differential privacy practical, since the algorithms require no knowledge of the domain. We consider both the setting where a user's data can modify an arbitrary number of counts by at most 1, i.e. unrestricted sensitivity, and the setting where a user's data can modify at most some small, fixed number of counts by at most 1, i.e. restricted sensitivity. Additionally, we provide a pay-what-you-get privacy composition bound for our algorithms. That is, our algorithms might return fewer than k elements when the top-k elements are queried, but the overall privacy budget only decreases by the size of the outcome set.

📄 PDF Abstract BibTeX

Code (1)

rrogers386/DPComposition 공식 구현

Tasks

Sensitivity

Similar Papers 제목 키워드 기반

A Simple and Practical Algorithm for Differentially Private Data Release

2012-12-01 · NeurIPS 2012 12 · Moritz Hardt, Katrina Ligett, Frank McSherry

We present a new algorithm for differentially private data release, based on a simple combination of the Exponential Mechanism with the Multiplicative Weights update rule. Our MWEM algorithm achieves what are the best k…

On the Importance of Architecture and Feature Selection in Differentially Private Machine Learning

2022-05-13 · Wenxuan Bao, Luke A. Bauer, Vincent Bindschaedler

We study a pitfall in the typical workflow for differentially private machine learning. The use of differentially private learning algorithms in a "drop-in" fashion -- without accounting for the impact of differential pr…

BIG-bench Machine LearningFeature Engineeringfeature selection

The Role of Adaptive Optimizers for Honest Private Hyperparameter Selection

2021-11-09 · NeurIPS 2021 12 · Shubhankar Mohapatra, Sajin Sasy, Xi He, Gautam Kamath 외

Hyperparameter optimization is a ubiquitous challenge in machine learning, and the performance of a trained model depends crucially upon their effective selection. While a rich set of tools exist for this purpose, there …

BIG-bench Machine LearningHyperparameter Optimization

Oneshot Differentially Private Top-k Selection

2021-05-18 · Gang Qiao, Weijie J. Su, Li Zhang

Being able to efficiently and accurately select the top-$k$ elements with differential privacy is an integral component of various private data analysis tasks. In this paper, we present the oneshot Laplace mechanism, whi…

Model-Agnostic Private Learning

2018-12-01 · NeurIPS 2018 12 · Raef Bassily, Abhradeep Guha Thakurta, Om Dipakbhai Thakkar

We design differentially private learning algorithms that are agnostic to the learning model assuming access to limited amount of unlabeled public data. First, we give a new differentially private algorithm for answering…

General ClassificationmodelTransfer Learning