paper-with-me

Papers

Enforcing Conditional Independence for Fair Representation Learning and Causal Image Generation

2024-04-21 · Jensen Hwa, Qingyu Zhao, Aditya Lahiri, Adnan Masood, Babak Salimi, Ehsan Adeli

Conditional independence (CI) constraints are critical for defining and evaluating fairness in machine learning, as well as for learning unconfounded or causal representations. Traditional methods for ensuring fairness either blindly learn invariant features with respect to a protected variable (e.g., race when classifying sex from face images) or enforce CI relative to the protected attribute only on the model output (e.g., the sex label). Neither of these methods are effective in enforcing CI in high-dimensional feature spaces. In this paper, we focus on a nascent approach characterizing the CI constraint in terms of two Jensen-Shannon divergence terms, and we extend it to high-dimensional feature spaces using a novel dynamic sampling strategy. In doing so, we introduce a new training paradigm that can be applied to any encoder architecture. We are able to enforce conditional independence of the diffusion autoencoder latent representation with respect to any protected attribute under the equalized odds constraint and show that this approach enables causal image generation with controllable latent spaces. Our experimental results demonstrate that our approach can achieve high accuracy on downstream tasks while upholding equality of odds.

📄 PDF Abstract BibTeX arXiv:2404.13798

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeFairnessImage GenerationRepresentation Learning

Methods 이 논문이 사용한 방법론

Focus 설명 없음
Diffusion Diffusion models generate samples by gradually removing noise from a signal, and their training objective can be expressed as a reweighted variational lower-bound…

Similar Papers 제목 키워드 기반

Causal Feature Selection for Algorithmic Fairness

2020-06-10 · Sainyam Galhotra, Karthikeyan Shanmugam, Prasanna Sattigeri, Kush R. Varshney

The use of machine learning (ML) in high-stakes societal decisions has encouraged the consideration of fairness throughout the ML lifecycle. Although data integration is one of the primary steps to generate high quality …

Data IntegrationFairnessfeature selectionManagement

Causal Domain Adaptation with Copula Entropy based Conditional Independence Test

2022-02-27 · Jian Ma

Domain Adaptation (DA) is a typical problem in machine learning that aims to transfer the model trained on source domain to target domain with different distribution. Causal DA is a special case of DA that solves the pro…

Causal DiscoveryDomain Adaptation

Learning Counterfactually Invariant Predictors

2022-07-20 · Francesco Quinzan, Cecilia Casolo, Krikamol Muandet, Yucen Luo 외

Notions of counterfactual invariance (CI) have proven essential for predictors that are fair, robust, and generalizable in the real world. We propose graphical criteria that yield a sufficient condition for a predictor t…

counterfactualObject Recognition

Representing Independence Models with Elementary Triplets

2016-12-04 · Jose M. Peña

In an independence model, the triplets that represent conditional independences between singletons are called elementary. It is known that the elementary triplets represent the independence model unambiguously under some…

A New Look at Causal Independence

2013-02-27 · David Heckerman, John S. Breese

Heckerman (1993) defined causal independence in terms of a set of temporal conditional independence statements. These statements formalized certain types of causal interaction where (1) the effect is independent of the o…