paper-with-me

Papers

SecureFedYJ: a safe feature Gaussianization protocol for Federated Learning

2022-10-04 · Tanguy Marchand, Boris Muzellec, Constance Beguier, Jean Ogier du Terrail, Mathieu Andreux

The Yeo-Johnson (YJ) transformation is a standard parametrized per-feature unidimensional transformation often used to Gaussianize features in machine learning. In this paper, we investigate the problem of applying the YJ transformation in a cross-silo Federated Learning setting under privacy constraints. For the first time, we prove that the YJ negative log-likelihood is in fact convex, which allows us to optimize it with exponential search. We numerically show that the resulting algorithm is more stable than the state-of-the-art approach based on the Brent minimization method. Building on this simple algorithm and Secure Multiparty Computation routines, we propose SecureFedYJ, a federated algorithm that performs a pooled-equivalent YJ transformation without leaking more information than the final fitted parameters do. Quantitative experiments on real data demonstrate that, in addition to being secure, our approach reliably normalizes features across silos as well as if data were pooled, making it a viable approach for safe federated feature Gaussianization.

📄 PDF Abstract BibTeX arXiv:2210.01639

Code (0)

등록된 구현이 없습니다.

Tasks

Federated Learning

Similar Papers 제목 키워드 기반

Gaussianization Flows

2020-03-04 · Chenlin Meng, Yang song, Jiaming Song, Stefano Ermon

Iterative Gaussianization is a fixed-point iteration procedure that can transform any continuous random vector into a Gaussian one. Based on iterative Gaussianization, we propose a new type of normalizing flow model that…

Radial-VCReg: More Informative Representation Learning Through Radial Gaussianization

2026-02-15 · Yilun Kuang, Yash Dagade, Deep Chakraborty, Erik Learned-Miller 외 arxiv

Self-supervised learning aims to learn maximally informative representations, but explicit information maximization is hindered by the curse of dimensionality. Existing methods like VCReg address this by regularizing fir…

Self-Supervised LearningRepresentation Learning

PDFed: Privacy-Preserving and Decentralized Asynchronous Federated Learning for Diffusion Models

2024-09-26 · Kar Balan, Andrew Gilbert, John Collomosse

We present PDFed, a decentralized, aggregator-free, and asynchronous federated learning protocol for training image diffusion models using a public blockchain. In general, diffusion models are prone to memorization of tr…

Federated LearningMemorizationPrivacy Preserving

Iterative Gaussianization: from ICA to Random Rotations

2016-01-31 · IEEE Transactions on Neural Networks 2011 2 · Valero Laparra, Gustavo Camps-Valls, Jesús Malo

Most signal processing problems involve the challenging task of multidimensional probability density function (PDF) estimation. In this work, we propose a solution to this problem by using a family of Rotation-based Iter…

DenoisingImage Generation

Attenuation of Seismic Random Noise With Unknown Distribution: A Gaussianization Framework

2023-07-25 · IEEE Transactions on Geoscience and Remote Sensing 2023 7 · Chuangji Meng, Jinghuai Gao, Yajun Tian, Liang Zhao 외

Random noise attenuation is a critical step in seismic data processing. Since the distribution of field noise is complex and unknown, this poses a challenge to noise attenuation methods where the default noise distributi…

DenoisingGeophysics