paper-with-me

홈 › Papers

An Interactive Framework for Finding the Optimal Trade-off in Differential Privacy

2025-09-04 · Yaohong Yang, Aki Rehn, Sammie Katt, Antti Honkela, Samuel Kaski arxiv

Differential privacy (DP) is the standard for privacy-preserving analysis, and introduces a fundamental trade-off between privacy guarantees and model performance. Selecting the optimal balance is a critical challenge that can be framed as a multi-objective optimization (MOO) problem where one first discovers the set of optimal trade-offs (the Pareto front) and then learns a decision-maker's preference over them. While a rich body of work on interactive MOO exists, the standard approach -- modeling the objective functions with generic surrogates and learning preferences from simple pairwise feedback -- is inefficient for DP because it fails to leverage the problem's unique structure: a point on the Pareto front can be generated directly by maximizing accuracy for a fixed privacy level. Motivated by this property, we first derive the shape of the trade-off theoretically, which allows us to model the Pareto front directly and efficiently. To address inefficiency in preference learning, we replace pairwise comparisons with a more informative interaction. In particular, we present the user with hypothetical trade-off curves and ask them to pick their preferred trade-off. Our experiments on differentially private logistic regression and deep transfer learning across six real-world datasets show that our method converges to the optimal privacy-accuracy trade-off with significantly less computational cost and user interaction than baselines.

📄 PDF Abstract BibTeX arXiv:2509.04290

Code (0)

등록된 구현이 없습니다.

Tasks

Transfer Learning

Similar Papers 제목 키워드 기반

Learning versus Refutation in Noninteractive Local Differential Privacy

2022-10-26 · Alexander Edmonds, Aleksandar Nikolov, Toniann Pitassi

We study two basic statistical tasks in non-interactive local differential privacy (LDP): learning and refutation. Learning requires finding a concept that best fits an unknown target function (from labelled samples draw…

PAC learning

Distributed DP-Helmet: Scalable Differentially Private Non-interactive Averaging of Single Layers

2022-11-03 · Moritz Kirschte, Sebastian Meiser, Saman Ardalan, Esfandiar Mohammadi

In this work, we propose two differentially private, non-interactive, distributed learning algorithms in a framework called Distributed DP-Helmet. Our framework is based on what we coin blind averaging: each user locally…

Federated Learning

Optimal Locally Private Nonparametric Classification with Public Data

2023-11-19 · Yuheng Ma, Hanfang Yang

In this work, we investigate the problem of public data assisted non-interactive Local Differentially Private (LDP) learning with a focus on non-parametric classification. Under the posterior drift assumption, we for the…

Classification

Bring Your Own Algorithm for Optimal Differentially Private Stochastic Minimax Optimization

2022-06-01 · Liang Zhang, Kiran Koshy Thekumparampil, Sewoong Oh, Niao He

We study differentially private (DP) algorithms for smooth stochastic minimax optimization, with stochastic minimization as a byproduct. The holy grail of these settings is to guarantee the optimal trade-off between the …

Optimal Compression of Locally Differentially Private Mechanisms

2021-10-29 · Abhin Shah, Wei-Ning Chen, Johannes Balle, Peter Kairouz 외

Compressing the output of \epsilon-locally differentially private (LDP) randomizers naively leads to suboptimal utility. In this work, we demonstrate the benefits of using schemes that jointly compress and privatize the …