paper-with-me

Papers

Fair Inference for Discrete Latent Variable Models

2022-09-15 · Rashidul Islam, SHimei Pan, James R. Foulds

It is now well understood that machine learning models, trained on data without due care, often exhibit unfair and discriminatory behavior against certain populations. Traditional algorithmic fairness research has mainly focused on supervised learning tasks, particularly classification. While fairness in unsupervised learning has received some attention, the literature has primarily addressed fair representation learning of continuous embeddings. In this paper, we conversely focus on unsupervised learning using probabilistic graphical models with discrete latent variables. We develop a fair stochastic variational inference technique for the discrete latent variables, which is accomplished by including a fairness penalty on the variational distribution that aims to respect the principles of intersectionality, a critical lens on fairness from the legal, social science, and humanities literature, and then optimizing the variational parameters under this penalty. We first show the utility of our method in improving equity and fairness for clustering using na\"ive Bayes and Gaussian mixture models on benchmark datasets. To demonstrate the generality of our approach and its potential for real-world impact, we then develop a special-purpose graphical model for criminal justice risk assessments, and use our fairness approach to prevent the inferences from encoding unfair societal biases.

📄 PDF Abstract BibTeX arXiv:2209.07044

Code (0)

등록된 구현이 없습니다.

Tasks

FairnessRepresentation LearningVariational Inference

Methods 이 논문이 사용한 방법론

Variational Inference 설명 없음

Similar Papers 제목 키워드 기반

Fair In-Context Learning via Latent Concept Variables

2024-11-04 · Karuna Bhaila, Minh-Hao Van, Kennedy Edemacu, Chen Zhao 외

The emerging in-context learning (ICL) ability of large language models (LLMs) has prompted their use for predictive tasks in various domains with different types of data facilitated by serialization methods. However, wi…

Data AugmentationFairnessIn-Context Learning

NASH: Toward End-to-End Neural Architecture for Generative Semantic Hashing

2018-05-14 · ACL 2018 7 · Dinghan Shen, Qinliang Su, Paidamoyo Chapfuwa, Wenlin Wang 외

Semantic hashing has become a powerful paradigm for fast similarity search in many information retrieval systems. While fairly successful, previous techniques generally require two-stage training, and the binary constrai…

Information RetrievalRetrievalVariational Inference

Relaxed-Responsibility Hierarchical Discrete VAEs

2020-07-14 · Matthew Willetts, Xenia Miscouridou, Stephen Roberts, Chris Holmes

Successfully training Variational Autoencoders (VAEs) with a hierarchy of discrete latent variables remains an area of active research. Vector-Quantised VAEs are a powerful approach to discrete VAEs, but naive hierarchic…

Unsupervised and interpretable scene discovery with Discrete-Attend-Infer-Repeat

2019-03-14 · Duo Wang, Mateja Jamnik, Pietro Lio

In this work we present Discrete Attend Infer Repeat (Discrete-AIR), a Recurrent Auto-Encoder with structured latent distributions containing discrete categorical distributions, continuous attribute distributions, and fa…

Attribute

Bayesian Beta-Bernoulli Process Sparse Coding with Deep Neural Networks

2023-03-14 · Arunesh Mittal, Kai Yang, Paul Sajda, John Paisley

Several approximate inference methods have been proposed for deep discrete latent variable models. However, non-parametric methods which have previously been successfully employed for classical sparse coding models have …