paper-with-me

홈 › Papers

Privacy-Preserving Conformal Prediction Under Local Differential Privacy

2025-05-21 · Coby Penso, Bar Mahpud, Jacob Goldberger, Or Sheffet

Conformal prediction (CP) provides sets of candidate classes with a guaranteed probability of containing the true class. However, it typically relies on a calibration set with clean labels. We address privacy-sensitive scenarios where the aggregator is untrusted and can only access a perturbed version of the true labels. We propose two complementary approaches under local differential privacy (LDP). In the first approach, users do not access the model but instead provide their input features and a perturbed label using a k-ary randomized response. In the second approach, which enforces stricter privacy constraints, users add noise to their conformity score by binary search response. This method requires access to the classification model but preserves both data and label privacy. Both approaches compute the conformal threshold directly from noisy data without accessing the true labels. We prove finite-sample coverage guarantees and demonstrate robust coverage even under severe randomization. This approach unifies strong local privacy with predictive uncertainty control, making it well-suited for sensitive applications such as medical imaging or large language model queries, regardless of whether users can (or are willing to) compute their own scores.

📄 PDF Abstract BibTeX arXiv:2505.15721

Code (1)

cobypenso/local-differential-private-conformal-prediction 공식 구현 pytorch

Tasks

Conformal PredictionLarge Language ModelPredictionPrivacy Preserving

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically

Similar Papers 제목 키워드 기반

Multi-Agent Conformal Prediction with Personalized Statistical Validity

2026-05-30 · Martin V. Vejling, Christophe A. N. Biscio, Adrien Mazoyer, Petar Popovski 외 arxiv

Uncertainty quantification is essential in high-stakes machine learning tasks. However, one of the principled solutions, conformal prediction, faces challenges under limited local calibration data, privacy constraints, a…

Beyond Data Splitting: Full-Data Conformal Prediction by Differential Privacy

2026-03-08 · Young Hyun Cho, Jordan Awan arxiv

Privacy protection and uncertainty quantification are increasingly important in data-driven decision making. Conformal prediction provides finite-sample marginal coverage, but existing private approaches often rely on da…

Decision Making

A Category-Theoretic Analysis of Conformal Prediction

2025-07-06 · Michele Caprio arxiv

Conformal prediction (CP) produces prediction regions with finite-sample, distribution free coverage guarantees, but its interpretation as a quantitative uncertainty tool is often left implicit. We develop a category-the…

Conformal Prediction for Privacy-Preserving Machine Learning

2025-07-13 · Alexander David Balinsky, Dominik Krzeminski, Alexander Balinsky arxiv

We investigate the integration of Conformal Prediction (CP) with supervised learning on deterministically encrypted data, aiming to bridge the gap between rigorous uncertainty quantification and privacy-preserving machin…

Conformal Prediction for Offensive Security

2026-09-04 · Giovanni Cherubin arxiv

Despite its introduction more than a quarter century ago, Conformal Prediction (CP) has seen surprisingly few applications to the cyber security world thus far. In particular, we observe that, while CP has been employed …