paper-with-me

Papers

Optimal Federated Learning for Nonparametric Regression with Heterogeneous Distributed Differential Privacy Constraints

2024-06-10 · T. Tony Cai, Abhinav Chakraborty, Lasse Vuursteen

This paper studies federated learning for nonparametric regression in the context of distributed samples across different servers, each adhering to distinct differential privacy constraints. The setting we consider is heterogeneous, encompassing both varying sample sizes and differential privacy constraints across servers. Within this framework, both global and pointwise estimation are considered, and optimal rates of convergence over the Besov spaces are established. Distributed privacy-preserving estimators are proposed and their risk properties are investigated. Matching minimax lower bounds, up to a logarithmic factor, are established for both global and pointwise estimation. Together, these findings shed light on the tradeoff between statistical accuracy and privacy preservation. In particular, we characterize the compromise not only in terms of the privacy budget but also concerning the loss incurred by distributing data within the privacy framework as a whole. This insight captures the folklore wisdom that it is easier to retain privacy in larger samples, and explores the differences between pointwise and global estimation under distributed privacy constraints.

📄 PDF Abstract BibTeX arXiv:2406.06755

Code (0)

등록된 구현이 없습니다.

Tasks

Federated LearningPrivacy Preservingregression

Similar Papers 제목 키워드 기반

Performance of Empirical Risk Minimization for Linear Regression with Dependent Data

2021-04-25 · Christian Brownlees, Guðmundur Stefán Guðmundsson

This paper establishes bounds on the performance of empirical risk minimization for large-dimensional linear regression. We generalize existing results by allowing the data to be dependent and heavy-tailed. The analysis …

regression

Optimal Distributed Learning with Multi-pass Stochastic Gradient Methods

2018-07-01 · ICML 2018 7 · Junhong Lin, Volkan Cevher

We study generalization properties of distributed algorithms in the setting of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We investigate distributed stochastic gradient methods (SGM), w…

regression

Federated Nonparametric Hypothesis Testing with Differential Privacy Constraints: Optimal Rates and Adaptive Tests

2024-06-10 · T. Tony Cai, Abhinav Chakraborty, Lasse Vuursteen

Federated learning has attracted significant recent attention due to its applicability across a wide range of settings where data is collected and analyzed across disparate locations. In this paper, we study federated no…

Federated Learning

Optimal Convergence for Distributed Learning with Stochastic Gradient Methods and Spectral Algorithms

2018-01-22 · Junhong Lin, Volkan Cevher

We study generalization properties of distributed algorithms in the setting of nonparametric regression over a reproducing kernel Hilbert space (RKHS). We first investigate distributed stochastic gradient methods (SGM), …

regression

Data-driven confidence bands for distributed nonparametric regression

2019-12-13 · Valeriy Avanesov

Gaussian Process Regression and Kernel Ridge Regression are popular nonparametric regression approaches. Unfortunately, they suffer from high computational complexity rendering them inapplicable to the modern massive dat…

regression