paper-with-me

홈 › Papers

$(ε, δ)$-Differentially Private Partial Least Squares Regression

2024-12-12 · Ramin Nikzad-Langerodi, Mohit Kumar, Du Nguyen Duy, Mahtab Alghasi

As data-privacy requirements are becoming increasingly stringent and statistical models based on sensitive data are being deployed and used more routinely, protecting data-privacy becomes pivotal. Partial Least Squares (PLS) regression is the premier tool for building such models in analytical chemistry, yet it does not inherently provide privacy guarantees, leaving sensitive (training) data vulnerable to privacy attacks. To address this gap, we propose an $(\epsilon, \delta)$-differentially private PLS (edPLS) algorithm, which integrates well-studied and theoretically motivated Gaussian noise-adding mechanisms into the PLS algorithm to ensure the privacy of the data underlying the model. Our approach involves adding carefully calibrated Gaussian noise to the outputs of four key functions in the PLS algorithm: the weights, scores, $X$-loadings, and $Y$-loadings. The noise variance is determined based on the global sensitivity of each function, ensuring that the privacy loss is controlled according to the $(\epsilon, \delta)$-differential privacy framework. Specifically, we derive the sensitivity bounds for each function and use these bounds to calibrate the noise added to the model components. Experimental results demonstrate that edPLS effectively renders privacy attacks, aimed at recovering unique sources of variability in the training data, ineffective. Application of edPLS to the NIR corn benchmark dataset shows that the root mean squared error of prediction (RMSEP) remains competitive even at strong privacy levels (i.e., $\epsilon=1$), given proper pre-processing of the corresponding spectra. These findings highlight the practical utility of edPLS in creating privacy-preserving multivariate calibrations and for the analysis of their privacy-utility trade-offs.

📄 PDF Abstract BibTeX arXiv:2412.09164

Code (0)

등록된 구현이 없습니다.

Tasks

Privacy PreservingregressionSensitivity

Similar Papers 제목 키워드 기반

Differentially Private Regression with Unbounded Covariates

2022-02-19 · Jason Milionis, Alkis Kalavasis, Dimitris Fotakis, Stratis Ioannidis

We provide computationally efficient, differentially private algorithms for the classical regression settings of Least Squares Fitting, Binary Regression and Linear Regression with unbounded covariates. Prior to our work…

regression

Insufficient Statistics Perturbation: Stable Estimators for Private Least Squares

2024-04-23 · Gavin Brown, Jonathan Hayase, Samuel Hopkins, Weihao Kong 외

We present a sample- and time-efficient differentially private algorithm for ordinary least squares, with error that depends linearly on the dimension and is independent of the condition number of $X^\top X$, where $X$ i…

Private Sketches for Linear Regression

2025-11-10 · Shrutimoy Das, Debanuj Nayak, Anirban Dasgupta arxiv

Linear regression is frequently applied in a variety of domains, some of which might contain sensitive information. This necessitates that the application of these methods does not reveal private information. Differentia…

Computational Efficiency

Refined Differentially Private Linear Regression via Extension of a Free Lunch Result

2026-04-11 · Sasmita Harini S, Anshoo Tandon arxiv

As data-privacy regulations tighten and statistical models are increasingly deployed on sensitive human-sourced data, privacy-preserving linear regression has become a critical necessity. For the add-remove DP model, Kul…

High-Dimensional Differentially Private Quantile Regression: Distributed Estimation and Statistical Inference

2025-08-07 · Ziliang Shen, Caixing Wang, Shaoli Wang, Yibo Yan arxiv

With the development of big data and machine learning, privacy concerns have become increasingly critical, especially when handling heterogeneous datasets containing sensitive personal information. Differential privacy p…