paper-with-me

Papers

Learning Fair Representations for Kernel Models

2019-06-27 · Zilong Tan, Samuel Yeom, Matt Fredrikson, Ameet Talwalkar

Fair representations are a powerful tool for establishing criteria like statistical parity, proxy non-discrimination, and equality of opportunity in learned models. Existing techniques for learning these representations are typically model-agnostic, as they preprocess the original data such that the output satisfies some fairness criterion, and can be used with arbitrary learning methods. In contrast, we demonstrate the promise of learning a model-aware fair representation, focusing on kernel-based models. We leverage the classical Sufficient Dimension Reduction (SDR) framework to construct representations as subspaces of the reproducing kernel Hilbert space (RKHS), whose member functions are guaranteed to satisfy fairness. Our method supports several fairness criteria, continuous and discrete data, and multiple protected attributes. We further show how to calibrate the accuracy tradeoff by characterizing it in terms of the principal angles between subspaces of the RKHS. Finally, we apply our approach to obtain the first Fair Gaussian Process (FGP) prior for fair Bayesian learning, and show that it is competitive with, and in some cases outperforms, state-of-the-art methods on real data.

📄 PDF Abstract BibTeX arXiv:1906.11813

Code (2)

ZilongTan/fgp 공식 구현
wnstlr/FACT pytorch

Tasks

Dimensionality ReductionFairness

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

MMD-B-Fair: Learning Fair Representations with Statistical Testing

2022-11-15 · Namrata Deka, Danica J. Sutherland

We introduce a method, MMD-B-Fair, to learn fair representations of data via kernel two-sample testing. We find neural features of our data where a maximum mean discrepancy (MMD) test cannot distinguish between represent…

Representation LearningTwo-sample testing

Fair Kernel Regression via Fair Feature Embedding in Kernel Space

2019-07-04 · Austin Okray, Hui Hu, Chao Lan

In recent years, there have been significant efforts on mitigating unethical demographic biases in machine learning methods. However, very little is done for kernel methods. In this paper, we propose a new fair kernel re…

BIG-bench Machine Learningfeature selectionregression

Incorporating Fairness Constraints into Archetypal Analysis

2025-07-16 · Aleix Alcacer, Irene Epifanio arxiv

Archetypal Analysis (AA) is an unsupervised learning method that represents data as convex combinations of extreme patterns called archetypes. While AA provides interpretable and low-dimensional representations, it can i…

Representation Learning

Conditional Contrastive Learning with Kernel

2022-02-11 · ICLR 2022 4 · Yao-Hung Hubert Tsai, Tianqin Li, Martin Q. Ma, Han Zhao 외

Conditional contrastive learning frameworks consider the conditional sampling procedure that constructs positive or negative data pairs conditioned on specific variables. Fair contrastive learning constructs negative pai…

Contrastive Learning

FairerCLIP: Debiasing CLIP's Zero-Shot Predictions using Functions in RKHSs

2024-03-22 · Sepehr Dehdashtian, Lan Wang, Vishnu Naresh Boddeti

Large pre-trained vision-language models such as CLIP provide compact and general-purpose representations of text and images that are demonstrably effective across multiple downstream zero-shot prediction tasks. However,…

Fairness