paper-with-me

홈 › Papers

Connect the dots: Dataset Condensation, Differential Privacy, and Adversarial Uncertainty

2024-02-16 · Kenneth Odoh

Our work focuses on understanding the underpinning mechanism of dataset condensation by drawing connections with ($\epsilon$, $\delta$)-differential privacy where the optimal noise, $\epsilon$, is chosen by adversarial uncertainty \cite{Grining2017}. We can answer the question about the inner workings of the dataset condensation procedure. Previous work \cite{dong2022} proved the link between dataset condensation (DC) and ($\epsilon$, $\delta$)-differential privacy. However, it is unclear from existing works on ablating DC to obtain a lower-bound estimate of $\epsilon$ that will suffice for creating high-fidelity synthetic data. We suggest that adversarial uncertainty is the most appropriate method to achieve an optimal noise level, $\epsilon$. As part of the internal dynamics of dataset condensation, we adopt a satisfactory scheme for noise estimation that guarantees high-fidelity data while providing privacy.

📄 PDF Abstract BibTeX arXiv:2402.10423

Code (0)

등록된 구현이 없습니다.

Tasks

Dataset CondensationNoise Estimation

Similar Papers 제목 키워드 기반

Privacy for Free: How does Dataset Condensation Help Privacy?

2022-06-01 · Tian Dong, Bo Zhao, Lingjuan Lyu

To prevent unintentional data leakage, research community has resorted to data generators that can produce differentially private data for model training. However, for the sake of the data privacy, existing solutions suf…

Dataset CondensationPrivacy Preserving

Democratising Clinical AI through Dataset Condensation for Classical Clinical Models

2026-03-10 · Anshul Thakur, Soheila Molaei, Pafue Christy Nganjimi, Joshua Fieggen 외 arxiv

Dataset condensation (DC) learns a compact synthetic dataset that enables models to match the performance of full-data training, prioritising utility over distributional fidelity. While typically explored for computation…

Computational Efficiency

Shuffle Gaussian Mechanism for Differential Privacy

2022-06-20 · Seng Pei Liew, Tsubasa Takahashi

We study Gaussian mechanism in the shuffle model of differential privacy (DP). Particularly, we characterize the mechanism's R\'enyi differential privacy (RDP), showing that it is of the form: $$ \epsilon(\lambda) \leq \…

Federated Learning

Simultaneous Private Learning of Multiple Concepts

2015-11-27 · Mark Bun, Kobbi Nissim, Uri Stemmer

We investigate the direct-sum problem in the context of differentially private PAC learning: What is the sample complexity of solving $k$ learning tasks simultaneously under differential privacy, and how does this cost c…

PAC learning

Littlestone Classes are Privately Online Learnable

2021-06-25 · NeurIPS 2021 12 · Noah Golowich, Roi Livni

We consider the problem of online classification under a privacy constraint. In this setting a learner observes sequentially a stream of labelled examples $(x_t, y_t)$, for $1 \leq t \leq T$, and returns at each iteratio…