Collaborative Learning From Distributed Data With Differentially Private Synthetic Twin Data

2023-08-09 · Lukas Prediger, Joonas Jälkö, Antti Honkela, Samuel Kaski

Consider a setting where multiple parties holding sensitive data aim to collaboratively learn population level statistics, but pooling the sensitive data sets is not possible. We propose a framework in which each party shares a differentially private synthetic twin of their data. We study the feasibility of combining such synthetic twin data sets for collaborative learning on real-world health data from the UK Biobank. We discover that parties engaging in the collaborative learning via shared synthetic data obtain more accurate estimates of target statistics compared to using only their local data. This finding extends to the difficult case of small heterogeneous data sets. Furthermore, the more parties participate, the larger and more consistent the improvements become. Finally, we find that data sharing can especially help parties whose data contain underrepresented groups to perform better-adjusted analysis for said groups. Based on our results we conclude that sharing of synthetic twins is a viable method for enabling learning from sensitive data without violating privacy constraints even if individual data sets are small or do not represent the overall population well. The setting of distributed sensitive data is often a bottleneck in biomedical research, which our study shows can be alleviated with privacy-preserving collaborative learning methods.

📄 PDF Abstract BibTeX arXiv:2308.04755

Code (1)

dpbayes/collaborative-learning-with-dp-synthetic-twin-data 공식 구현 jax

Tasks

Privacy Preserving

Federated Learning in Non-IID Settings Aided by Differentially Private Synthetic Data

2022-06-01 · Huancheng Chen, Haris Vikalo

Federated learning (FL) is a privacy-promoting framework that enables potentially large number of clients to collaboratively train machine learning models. In a FL system, a server coordinates the collaboration by collec…

Federated Learning image-classification Image Classification

Differentially Private ADMM for Convex Distributed Learning: Improved Accuracy via Multi-Step Approximation

2020-05-16 · Zonghao Huang, Yanmin Gong

Alternating Direction Method of Multipliers (ADMM) is a popular algorithm for distributed learning, where a network of nodes collaboratively solve a regularized empirical risk minimization by iterative local computation …

How to Democratise and Protect AI: Fair and Differentially Private Decentralised Deep Learning

2020-07-18 · Lingjuan Lyu, Yitong Li, Karthik Nandakumar, Jiangshan Yu 외

This paper firstly considers the research problem of fairness in collaborative deep learning, while ensuring privacy. A novel reputation system is proposed through digital tokens and local credibility to ensure fairness,…

Deep Learning Fairness Generative Adversarial Network Privacy Preserving+1

Distributed Differentially-Private Algorithms for Matrix and Tensor Factorization

2018-04-26 · Hafiz Imtiaz, Anand D. Sarwate

In many signal processing and machine learning applications, datasets containing private information are held at different locations, requiring the development of distributed privacy-preserving algorithms. Tensor and mat…

Privacy Preserving Tensor Decomposition

Federated Learning with GAN-based Data Synthesis for Non-IID Clients

2022-06-11 · Zijian Li, Jiawei Shao, Yuyi Mao, Jessie Hui Wang 외

Federated learning (FL) has recently emerged as a popular privacy-preserving collaborative learning paradigm. However, it suffers from the non-independent and identically distributed (non-IID) data among clients. In this…

Federated Learning Generative Adversarial Network Privacy Preserving