FAIRM: Learning invariant representations for algorithmic fairness and domain generalization with minimax optimality
Machine learning methods often assume that the test data have the same distribution as the training data. However, this assumption may not hold due to multiple levels of heterogeneity in applications, raising issues in algorithmic fairness and domain generalization. In this work, we address the problem of fair and generalizable machine learning by invariant principles. We propose a training environment-based oracle, FAIRM, which has desirable fairness and domain generalization properties under a diversity-type condition. We then provide an empirical FAIRM with finite-sample theoretical guarantees under weak distributional assumptions. We then develop efficient algorithms to realize FAIRM in linear models and demonstrate the nonasymptotic performance with minimax optimality. We evaluate our method in numerical experiments with synthetic data and MNIST data and show that it outperforms its counterparts.
Code (1)
Tasks
DiversityDomain GeneralizationFairnessSimilar Papers 제목 키워드 기반
FairMILE: Towards an Efficient Framework for Fair Graph Representation Learning
Graph representation learning models have demonstrated great capability in many real-world applications. Nevertheless, prior research indicates that these models can learn biased representations leading to discriminatory…
FairnessGraph EmbeddingGraph Representation LearningRepresentation LearningLearning Fair Graph Representations with Multi-view Information Bottleneck
Graph neural networks (GNNs) excel on relational data by passing messages over node features and structure, but they can amplify training data biases, propagating discriminatory attributes and structural imbalances into …
Representation LearningContrastive LearningFairness-Aware Few-Shot Learning for Audio-Visual Stress Detection
Fairness in AI-driven stress detection is critical for equitable mental healthcare, yet existing models frequently exhibit gender bias, particularly in data-scarce scenarios. To address this, we propose FairM2S, a fairne…
Few-Shot LearningFairMT-Bench: Benchmarking Fairness for Multi-turn Dialogue in Conversational LLMs
The growing use of large language model (LLM)-based chatbots has raised concerns about fairness. Fairness issues in LLMs can lead to severe consequences, such as bias amplification, discrimination, and harm to marginaliz…
BenchmarkingFairnessLarge Language ModelFairMixRep : Self-supervised Robust Representation Learning for Heterogeneous Data with Fairness constraints
Representation Learning in a heterogeneous space with mixed variables of numerical and categorical types has interesting challenges due to its complex feature manifold. Moreover, feature learning in an unsupervised setup…
DecoderFairnessRepresentation Learning