paper-with-me

홈 › Papers

Fair Normalizing Flows

2021-06-10 · ICLR 2022 4 · Mislav Balunović, Anian Ruoss, Martin Vechev

Fair representation learning is an attractive approach that promises fairness of downstream predictors by encoding sensitive data. Unfortunately, recent work has shown that strong adversarial predictors can still exhibit unfairness by recovering sensitive attributes from these representations. In this work, we present Fair Normalizing Flows (FNF), a new approach offering more rigorous fairness guarantees for learned representations. Specifically, we consider a practical setting where we can estimate the probability density for sensitive groups. The key idea is to model the encoder as a normalizing flow trained to minimize the statistical distance between the latent representations of different groups. The main advantage of FNF is that its exact likelihood computation allows us to obtain guarantees on the maximum unfairness of any potentially adversarial downstream predictor. We experimentally demonstrate the effectiveness of FNF in enforcing various group fairness notions, as well as other attractive properties such as interpretability and transfer learning, on a variety of challenging real-world datasets.

📄 PDF Abstract BibTeX arXiv:2106.05937

Code (1)

eth-sri/fnf 공식 구현 pytorch

Tasks

FairnessRepresentation LearningTransfer Learning

Methods 이 논문이 사용한 방법론

Normalizing Flows Normalizing Flows are a method for constructing complex distributions by transforming a probability density through a series of invertible mappings. By repeatedly applying…

Similar Papers 제목 키워드 기반

Sylvester Normalizing Flows for Variational Inference

2018-03-15 · Rianne van den Berg, Leonard Hasenclever, Jakub M. Tomczak, Max Welling

Variational inference relies on flexible approximate posterior distributions. Normalizing flows provide a general recipe to construct flexible variational posteriors. We introduce Sylvester normalizing flows, which can b…

Variational Inference

Flows for Flows: Training Normalizing Flows Between Arbitrary Distributions with Maximum Likelihood Estimation

2022-11-04 · Samuel Klein, John Andrew Raine, Tobias Golling

Normalizing flows are constructed from a base distribution with a known density and a diffeomorphism with a tractable Jacobian. The base density of a normalizing flow can be parameterised by a different normalizing flow,…

Fair Group-Shared Representations with Normalizing Flows

2022-01-17 · Mattia Cerrato, Marius Köppel, Alexander Segner, Stefan Kramer

The issue of fairness in machine learning stems from the fact that historical data often displays biases against specific groups of people which have been underprivileged in the recent past, or still are. In this context…

AttributeFairnessRepresentation Learning

Learning normalizing flows from Entropy-Kantorovich potentials

2020-06-10 · Chris Finlay, Augusto Gerolin, Adam M. Oberman, Aram-Alexandre Pooladian

We approach the problem of learning continuous normalizing flows from a dual perspective motivated by entropy-regularized optimal transport, in which continuous normalizing flows are cast as gradients of scalar potential…

Projected Latent Markov Chain Monte Carlo: Conditional Sampling of Normalizing Flows

2020-07-13 · ICLR 2021 1 · Chris Cannella, Mohammadreza Soltani, Vahid Tarokh

We introduce Projected Latent Markov Chain Monte Carlo (PL-MCMC), a technique for sampling from the high-dimensional conditional distributions learned by a normalizing flow. We prove that a Metropolis-Hastings implementa…