paper-with-me

홈 › Papers

Optimal Algorithms for Differentially Private Stochastic Monotone Variational Inequalities and Saddle-Point Problems

2021-04-07 · Digvijay Boob, Cristóbal Guzmán

In this work, we conduct the first systematic study of stochastic variational inequality (SVI) and stochastic saddle point (SSP) problems under the constraint of differential privacy (DP). We propose two algorithms: Noisy Stochastic Extragradient (NSEG) and Noisy Inexact Stochastic Proximal Point (NISPP). We show that a stochastic approximation variant of these algorithms attains risk bounds vanishing as a function of the dataset size, with respect to the strong gap function; and a sampling with replacement variant achieves optimal risk bounds with respect to a weak gap function. We also show lower bounds of the same order on weak gap function. Hence, our algorithms are optimal. Key to our analysis is the investigation of algorithmic stability bounds, both of which are new even in the nonprivate case. The dependence of the running time of the sampling with replacement algorithms, with respect to the dataset size $n$, is $n^2$ for NSEG and $\tilde{O}(n^{3/2})$ for NISPP.

📄 PDF Abstract BibTeX arXiv:2104.02988

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Differentially Private Decomposable Submodular Maximization

2020-05-29 · Anamay Chaturvedi, Huy Nguyen, Lydia Zakynthinou

We study the problem of differentially private constrained maximization of decomposable submodular functions. A submodular function is decomposable if it takes the form of a sum of submodular functions. The special case …

Differentially Private Submodular Maximization: Data Summarization in Disguise

2017-08-01 · ICML 2017 8 · Marko Mitrovic, Mark Bun, Andreas Krause, Amin Karbasi

Many data summarization applications are captured by the general framework of submodular maximization. As a consequence, a wide range of efficient approximation algorithms have been developed. However, when such app…

Data SummarizationPrivacy Preserving

Near-Optimal Algorithms for Differentially Private Online Learning in a Stochastic Environment

2021-02-16 · Bingshan Hu, Zhiming Huang, Nishant A. Mehta, Nidhi Hegde

In this paper, we study differentially private online learning problems in a stochastic environment under both bandit and full information feedback. For differentially private stochastic bandits, we propose both UCB and …

Thompson Sampling

Privately Estimating Monotone Statistics in Polynomial Time

2026-05-27 · Gavin Brown, Ephraim Linder, Mahbod Majid, Vikrant Singhal arxiv

We study efficient differentially private algorithms for estimating monotone statistics, i.e., statistics that are monotone under the addition of new observations. The starting point for our investigation is subsample-an…

Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization

2022-06-01 · Liang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao He

We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the …