paper-with-me

Papers

On the Query Complexity of Training Data Reconstruction in Private Learning

2023-03-29 · Prateeti Mukherjee, Satya Lokam

We analyze the number of queries that a whitebox adversary needs to make to a private learner in order to reconstruct its training data. For $(\epsilon, \delta)$ DP learners with training data drawn from any arbitrary compact metric space, we provide the \emph{first known lower bounds on the adversary's query complexity} as a function of the learner's privacy parameters. \emph{Our results are minimax optimal for every $\epsilon \geq 0, \delta \in [0, 1]$, covering both $\epsilon$-DP and $(0, \delta)$ DP as corollaries}. Beyond this, we obtain query complexity lower bounds for $(\alpha, \epsilon)$ R\'enyi DP learners that are valid for any $\alpha > 1, \epsilon \geq 0$. Finally, we analyze data reconstruction attacks on locally compact metric spaces via the framework of Metric DP, a generalization of DP that accounts for the underlying metric structure of the data. In this setting, we provide the first known analysis of data reconstruction in unbounded, high dimensional spaces and obtain query complexity lower bounds that are nearly tight modulo logarithmic factors.

📄 PDF Abstract BibTeX arXiv:2303.16372

Code (0)

등록된 구현이 없습니다.

Tasks

Decision Makingvalid

Methods 이 논문이 사용한 방법론

SGD Stochastic Gradient Descent is an iterative optimization technique that uses minibatches of data to form an expectation of the gradient, rather than the full gradient using…

Similar Papers 제목 키워드 기반

Private Query Release Assisted by Public Data

2020-04-23 · ICML 2020 1 · Raef Bassily, Albert Cheu, Shay Moran, Aleksandar Nikolov 외

We study the problem of differentially private query release assisted by access to public data. In this problem, the goal is to answer a large class $\mathcal{H}$ of statistical queries with error no more than $\alpha$ u…

Efficient and Private Marginal Reconstruction with Local Non-Negativity

2024-10-01 · Brett Mullins, Miguel Fuentes, Yingtai Xiao, Daniel Kifer 외

Differential privacy is the dominant standard for formal and quantifiable privacy and has been used in major deployments that impact millions of people. Many differentially private algorithms for query release and synthe…

Optimal query complexity for private sequential learning against eavesdropping

2019-09-21 · Jiaming Xu, Kuang Xu, Dana Yang

We study the query complexity of a learner-private sequential learning problem, motivated by the privacy and security concerns due to eavesdropping that arise in practical applications such as pricing and Federated Learn…

Federated Learning

Query Complexity of Bayesian Private Learning

2019-11-15 · NeurIPS 2018 12 · Kuang Xu

We study the query complexity of Bayesian Private Learning: a learner wishes to locate a random target within an interval by submitting queries, in the presence of an adversary who observes all of her queries but not the…

Private Sequential Learning

2018-05-06 · John N. Tsitsiklis, Kuang Xu, Zhi Xu

We formulate a private learning model to study an intrinsic tradeoff between privacy and query complexity in sequential learning. Our model involves a learner who aims to determine a scalar value, $v^*$, by sequentially …