paper-with-me

Papers

Fair Wasserstein Coresets

2023-11-09 · Zikai Xiong, Niccolò Dalmasso, Shubham Sharma, Freddy Lecue, Daniele Magazzeni, Vamsi K. Potluru, Tucker Balch, Manuela Veloso

Data distillation and coresets have emerged as popular approaches to generate a smaller representative set of samples for downstream learning tasks to handle large-scale datasets. At the same time, machine learning is being increasingly applied to decision-making processes at a societal level, making it imperative for modelers to address inherent biases towards subgroups present in the data. While current approaches focus on creating fair synthetic representative samples by optimizing local properties relative to the original samples, their impact on downstream learning processes has yet to be explored. In this work, we present fair Wasserstein coresets (FWC), a novel coreset approach which generates fair synthetic representative samples along with sample-level weights to be used in downstream learning tasks. FWC uses an efficient majority minimization algorithm to minimize the Wasserstein distance between the original dataset and the weighted synthetic samples while enforcing demographic parity. We show that an unconstrained version of FWC is equivalent to Lloyd's algorithm for k-medians and k-means clustering. Experiments conducted on both synthetic and real datasets show that FWC: (i) achieves a competitive fairness-utility tradeoff in downstream models compared to existing approaches, (ii) improves downstream fairness when added to the existing training data and (iii) can be used to reduce biases in predictions from large language models (GPT-3.5 and GPT-4).

📄 PDF Abstract BibTeX arXiv:2311.05436

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDecision MakingFairness

Methods 이 논문이 사용한 방법론

SET Dynamic Sparse Training method where weight mask is updated randomly periodically
Focus 설명 없음
Coresets 설명 없음

Similar Papers 제목 키워드 기반

Wasserstein Measure Coresets

2018-05-18 · Sebastian Claici, Aude Genevay, Justin Solomon

The proliferation of large data sets and Bayesian inference techniques motivates demand for better data sparsification. Coresets provide a principled way of summarizing a large dataset via a smaller one that is guarantee…

Bayesian InferenceClustering

On Coresets for Fair Clustering in Metric and Euclidean Spaces and Their Applications

2020-07-20 · Sayan Bandyapadhyay, Fedor V. Fomin, Kirill Simonov

Fair clustering is a constrained variant of clustering where the goal is to partition a set of colored points, such that the fraction of points of any color in every cluster is more or less equal to the fraction of point…

ClusteringConstrained Clustering

On Divergence Measures for Bayesian Pseudocoresets

2022-10-12 · Balhae Kim, JungWon Choi, Seanie Lee, Yoonho Lee 외

A Bayesian pseudocoreset is a small synthetic dataset for which the posterior over parameters approximates that of the original dataset. While promising, the scalability of Bayesian pseudocoresets is not yet validated in…

Bayesian InferenceDataset Distillationimage-classificationImage Classification

Federated Wasserstein Distance

2023-10-03 · Alain Rakotomamonjy, Kimia Nadjahi, Liva Ralaivola

We introduce a principled way of computing the Wasserstein distance between two distributions in a federated manner. Namely, we show how to estimate the Wasserstein distance between two samples stored and kept on differe…

Federated Learning

Coresets for Clustering with Fairness Constraints

2019-06-20 · NeurIPS 2019 12 · Lingxiao Huang, Shaofeng H. -C. Jiang, Nisheeth K. Vishnoi

In a recent work, [19] studied the following "fair" variants of classical clustering problems such as $k$-means and $k$-median: given a set of $n$ data points in $\mathbb{R}^d$ and a binary type associated to each data p…

ClusteringFairness