SF-PATE: Scalable, Fair, and Private Aggregation of Teacher Ensembles

2022-04-11 · Cuong Tran, Keyu Zhu, Ferdinando Fioretto, Pascal Van Hentenryck

A critical concern in data-driven processes is to build models whose outcomes do not discriminate against some demographic groups, including gender, ethnicity, or age. To ensure non-discrimination in learning tasks, knowledge of the group attributes is essential. However, in practice, these attributes may not be available due to legal and ethical requirements. To address this challenge, this paper studies a model that protects the privacy of the individuals' sensitive information while also allowing it to learn non-discriminatory predictors. A key characteristic of the proposed model is to enable the adoption of off-the-selves and non-private fair models to create a privacy-preserving and fair model. The paper analyzes the relation between accuracy, privacy, and fairness, and the experimental evaluation illustrates the benefits of the proposed models on several prediction tasks. In particular, this proposal is the first to allow both scalable and accurate training of private and fair models for very large neural networks.

📄 PDF Abstract BibTeX arXiv:2204.05157

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessPrivacy Preserving

A Fairness Analysis on Private Aggregation of Teacher Ensembles

2021-09-17 · Cuong Tran, My H. Dinh, Kyle Beiter, Ferdinando Fioretto

The Private Aggregation of Teacher Ensembles (PATE) is an important private machine learning framework. It combines multiple learning models used as teachers for a student model that learns to predict an output chosen by…

Fairness Privacy Preserving

G-PATE: Scalable Differentially Private Data Generator via Private Aggregation of Teacher Discriminators

2019-06-21 · NeurIPS 2021 12 · Yunhui Long, Boxin Wang, Zhuolin Yang, Bhavya Kailkhura 외

Recent advances in machine learning have largely benefited from the massive accessible training data. However, large-scale data sharing has raised great privacy concerns. In this work, we propose a novel privacy-preservi…

BIG-bench Machine Learning Privacy Preserving

On the Fairness Impacts of Private Ensembles Models

2023-05-19 · Cuong Tran, Ferdinando Fioretto

The Private Aggregation of Teacher Ensembles (PATE) is a machine learning framework that enables the creation of private models through the combination of multiple "teacher" models and a "student" model. The student mode…

Fairness

Scalable Differentially Private Data Generation via Private Aggregation of Teacher Ensembles

2019-09-25 · Yunhui Long, Suxin Lin, Zhuolin Yang, Carl A. Gunter 외

We present a novel approach named G-PATE for training differentially private data generator. The generator can be used to produce synthetic datasets with strong privacy guarantee while preserving high data utility. Our a…

Quantum Privacy Aggregation of Teacher Ensembles (QPATE) for Privacy-preserving Quantum Machine Learning

2024-01-15 · William Watkins, Heehwan Wang, Sangyoon Bae, Huan-Hsin Tseng 외

The utility of machine learning has rapidly expanded in the last two decades and presents an ethical challenge. Papernot et. al. developed a technique, known as Private Aggregation of Teacher Ensembles (PATE) to enable f…

Federated Learning Privacy Preserving Quantum Machine Learning