paper-with-me

홈 › Papers

Exploiting MMD and Sinkhorn Divergences for Fair and Transferable Representation Learning

2020-12-01 · NeurIPS 2020 12 · Luca Oneto, Michele Donini, Giulia Luise, Carlo Ciliberto, Andreas Maurer, Massimiliano Pontil

Developing learning methods which do not discriminate subgroups in the population is a central goal of algorithmic fairness. One way to reach this goal is by modifying the data representation in order to meet certain fairness constraints. In this work we measure fairness according to demographic parity. This requires the probability of the possible model decisions to be independent of the sensitive information. We argue that the goal of imposing demographic parity can be substantially facilitated within a multitask learning setting. We present a method for learning a shared fair representation across multiple tasks, by means of different new constraints based on MMD and Sinkhorn Divergences. We derive learning bounds establishing that the learned representation transfers well to novel tasks. We present experiments on three real world datasets, showing that the proposed method outperforms state-of-the-art approaches by a significant margin.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessRepresentation Learning

Similar Papers 제목 키워드 기반

Optimal transport with $f$-divergence regularization and generalized Sinkhorn algorithm

2021-05-29 · Dávid Terjék, Diego González-Sánchez

Entropic regularization provides a generalization of the original optimal transport problem. It introduces a penalty term defined by the Kullback-Leibler divergence, making the problem more tractable via the celebrated S…

Sinkhorn Divergences for Unbalanced Optimal Transport

2019-10-28 · Thibault Séjourné, Jean Feydy, François-Xavier Vialard, Alain Trouvé 외

Optimal transport induces the Earth Mover's (Wasserstein) distance between probability distributions, a geometric divergence that is relevant to a wide range of problems. Over the last decade, two relaxations of optimal …

Learning Controllable Fair Representations

2018-12-11 · Jiaming Song, Pratyusha Kalluri, Aditya Grover, Shengjia Zhao 외

Learning data representations that are transferable and are fair with respect to certain protected attributes is crucial to reducing unfair decisions while preserving the utility of the data. We propose an information-th…

Fairness

On the contraction properties of Sinkhorn semigroups

2025-03-12 · O. Deniz Akyildiz, Pierre Del Moral, Joaquin Miguez

We develop a novel semigroup contraction analysis based on Lyapunov techniques to prove the exponential convergence of Sinkhorn equations on weighted Banach spaces. This operator-theoretic framework yields exponential de…

Density Estimation

Sinkhorn Distance Minimization for Knowledge Distillation

2024-02-27 · Xiao Cui, Yulei Qin, Yuting Gao, Enwei Zhang 외

Knowledge distillation (KD) has been widely adopted to compress large language models (LLMs). Existing KD methods investigate various divergence measures including the Kullback-Leibler (KL), reverse Kullback-Leibler (RKL…

DecoderKnowledge Distillation