paper-with-me

Papers

Bounding, Concentrating, and Truncating: Unifying Privacy Loss Composition for Data Analytics

2020-04-15 · Mark Cesar, Ryan Rogers

Differential privacy (DP) provides rigorous privacy guarantees on individual's data while also allowing for accurate statistics to be conducted on the overall, sensitive dataset. To design a private system, first private algorithms must be designed that can quantify the privacy loss of each outcome that is released. However, private algorithms that inject noise into the computation are not sufficient to ensure individuals' data is protected due to many noisy results ultimately concentrating to the true, non-privatized result. Hence there have been several works providing precise formulas for how the privacy loss accumulates over multiple interactions with private algorithms. However, these formulas either provide very general bounds on the privacy loss, at the cost of being overly pessimistic for certain types of private algorithms, or they can be too narrow in scope to apply to general privacy systems. In this work, we unify existing privacy loss composition bounds for special classes of differentially private (DP) algorithms along with general DP composition bounds. In particular, we provide strong privacy loss bounds when an analyst may select pure DP, bounded range (e.g. exponential mechanisms), or concentrated DP mechanisms in any order. We also provide optimal privacy loss bounds that apply when an analyst can select pure DP and bounded range mechanisms in a batch, i.e. non-adaptively. Further, when an analyst selects mechanisms within each class adaptively, we show a difference in privacy loss between different, predetermined orderings of pure DP and bounded range mechanisms. Lastly, we compare the composition bounds of Laplace and Gaussian mechanisms based on histogram datasets.

📄 PDF Abstract BibTeX arXiv:2004.07223

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Improving Panoptic Segmentation at All Scales

2020-12-14 · CVPR 2021 1 · Lorenzo Porzi, Samuel Rota Bulò, Peter Kontschieder

Crop-based training strategies decouple training resolution from GPU memory consumption, allowing the use of large-capacity panoptic segmentation networks on multi-megapixel images. Using crops, however, can introduce a …

AllGPUPanoptic SegmentationSegmentation

Learning with Non-Convex Truncated Losses by SGD

2018-05-21 · Yi Xu, Shenghuo Zhu, Sen yang, Chi Zhang 외

Learning with a {\it convex loss} function has been a dominating paradigm for many years. It remains an interesting question how non-convex loss functions help improve the generalization of learning with broad applicabil…

Individual Privacy Accounting via a Renyi Filter

2020-08-25 · NeurIPS 2021 12 · Vitaly Feldman, Tijana Zrnic

We consider a sequential setting in which a single dataset of individuals is used to perform adaptively-chosen analyses, while ensuring that the differential privacy loss of each participant does not exceed a pre-specifi…

Individual Privacy Accounting via a Rényi Filter

2021-05-21 · NeurIPS 2021 12 · Vitaly Feldman, Tijana Zrnic

We consider a sequential setting in which a single dataset of individuals is used to perform adaptively-chosen analyses, while ensuring that the differential privacy loss of each participant does not exceed a pre-specifi…

Individual Privacy Accounting with Gaussian Differential Privacy

2022-09-30 · Antti Koskela, Marlon Tobaben, Antti Honkela

Individual privacy accounting enables bounding differential privacy (DP) loss individually for each participant involved in the analysis. This can be informative as often the individual privacy losses are considerably sm…