paper-with-me

Papers

Uncertainty quantification by block bootstrap for differentially private stochastic gradient descent

2024-05-21 · Holger Dette, Carina Graw

Stochastic Gradient Descent (SGD) is a widely used tool in machine learning. In the context of Differential Privacy (DP), SGD has been well studied in the last years in which the focus is mainly on convergence rates and privacy guarantees. While in the non private case, uncertainty quantification (UQ) for SGD by bootstrap has been addressed by several authors, these procedures cannot be transferred to differential privacy due to multiple queries to the private data. In this paper, we propose a novel block bootstrap for SGD under local differential privacy that is computationally tractable and does not require an adjustment of the privacy budget. The method can be easily implemented and is applicable to a broad class of estimation problems. We prove the validity of our approach and illustrate its finite sample properties by means of a simulation study. As a by-product, the new method also provides a simple alternative numerical tool for UQ for non-private SGD.

📄 PDF Abstract BibTeX arXiv:2405.12553

Code (0)

등록된 구현이 없습니다.

Tasks

Uncertainty Quantification

Methods 이 논문이 사용한 방법론

NON 설명 없음
Focus 설명 없음
SGD Stochastic Gradient Descent is an iterative optimization technique that uses minibatches of data to form an expectation of the gradient, rather than the full gradient using…

Similar Papers 제목 키워드 기반

Noise-Calibrated Inference from Differentially Private Sufficient Statistics in Exponential Families

2026-03-02 · Amir Asiaee, Samhita Pal arxiv

Many differentially private (DP) data release systems either output DP synthetic data and leave analysts to perform inference as usual, which can lead to severe miscalibration, or output a DP point estimate without a pri…

Synthetic Data Generation

Gaussian Differential Private Bootstrap by Subsampling

2025-05-02 · Holger Dette, Carina Graw

Bootstrap is a common tool for quantifying uncertainty in data analysis. However, besides additional computational costs in the application of the bootstrap on massive data, a challenging problem in bootstrap based infer…

Uncertainty Quantification

The Influence of Dropout on Membership Inference in Differentially Private Models

2021-03-16 · Erick Galinkin

Differentially private models seek to protect the privacy of data the model is trained on, making it an important component of model security and privacy. At the same time, data scientists and machine learning engineers …

BIG-bench Machine LearningUncertainty Quantification

PrivATE: Differentially Private Confidence Intervals for Average Treatment Effects

2025-05-27 · Maresa Schröder, Justin Hartenstein, Stefan Feuerriegel

The average treatment effect (ATE) is widely used to evaluate the effectiveness of drugs and other medical interventions. In safety-critical applications like medicine, reliable inferences about the ATE typically require…

Privacy PreservingUncertainty Quantificationvalid

Differentially Private Nonparametric Confidence Intervals Under Minimal Distributional Assumptions

2025-11-03 · Tomer Shoham, Moshe Shenfeld, Noa Velner-Harris, Katrina Ligett arxiv

We consider the problem of constructing differentially private nonparametric confidence intervals (CIs) for an arbitrary quantity using resampling. A growing body of work has adapted resampling ideas to the private setti…