SecureFedYJ: a safe feature Gaussianization protocol for Federated Learning
The Yeo-Johnson (YJ) transformation is a standard parametrized per-feature unidimensional transformation often used to Gaussianize features in machine learning. In this paper, we investigate the problem of applying the YJ transformation in a cross-silo Federated Learning setting under privacy constraints. For the first time, we prove that the YJ negative log-likelihood is in fact convex, which allows us to optimize it with exponential search. We numerically show that the resulting algorithm is more stable than the state-of-the-art approach based on the Brent minimization method. Building on this simple algorithm and Secure Multiparty Computation routines, we propose SecureFedYJ, a federated algorithm that performs a pooled-equivalent YJ transformation without leaking more information than the final fitted parameters do. Quantitative experiments on real data demonstrate that, in addition to being secure, our approach reliably normalizes features across silos as well as if data were pooled, making it a viable approach for safe federated feature Gaussianization.
Code (0)
등록된 구현이 없습니다.
Tasks
Federated LearningSimilar Papers 제목 키워드 기반
Gaussianization Flows
Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that…
Radial-VCReg: More Informative Representation Learning Through Radial Gaussianization
Self-supervised learning aims to learn maximally informative representations, but explicit information maximization is hindered by the curse of dimensionality. Existing methods like VCReg address this by regularizing fir…
Self-Supervised LearningRepresentation LearningPDFed: Privacy-Preserving and Decentralized Asynchronous Federated Learning for Diffusion Models
We present PDFed, a decentralized, aggregator-free, and asynchronous federated learning protocol for training image diffusion models using a public blockchain. In general, diffusion models are prone to memorization of tr…
Federated LearningMemorizationPrivacy PreservingIterative Gaussianization: from ICA to Random Rotations
Most signal processing problems involve the challenging task of multidimensional probability density function (PDF) estimation. In this work, we propose a solution to this problem by using a family of Rotation-based Iter…
DenoisingImage GenerationAttenuation of Seismic Random Noise With Unknown Distribution: A Gaussianization Framework
Random noise attenuation is a critical step in seismic data processing. Since the distribution of field noise is complex and unknown, this poses a challenge to noise attenuation methods where the default noise distributi…
DenoisingGeophysics