paper-with-me

홈 › Papers

No-Free-Fairness: Fundamental Limits and Trade-offs in Learning Systems

2026-06-16 · Khoat Than arxiv

In this paper, we establish a set of theoretical impossibility results, termed the No-Free-Fairness theorems, that identify three fundamental sources of disparity in learning systems. First, we show that when a task exhibits irreducible cost on a subgroup, any decision rule must trade off overall performance with disparity, yielding an inherent fairness--cost frontier. Second, we prove that even in ideal, noise-free settings where a perfectly fair and accurate solution exists, finite-sample learning alone induces nontrivial subgroup disparity, ruling out distribution-free fairness guarantees. More seriously, enforcing strict relative fairness creates a statistical bottleneck: achieving low cost may require exponentially many samples. Third, we show that limitations of the model class can independently induce disparity: if the model cannot represent accurate solutions for a subgroup, fairness remains unattainable regardless of data or training procedure. Overall, these results demonstrate that unfairness is not solely a consequence of biased data or suboptimal optimization, but arises from the intrinsic structure of decision problems, the constraints of finite data, and the expressivity of models. Our framework applies broadly beyond standard supervised learning, and suggests that achieving fairness requires explicit trade-offs and should be treated as a core design consideration.

📄 PDF Abstract BibTeX arXiv:2606.17810

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Demystifying Local and Global Fairness Trade-offs in Federated Learning Using Partial Information Decomposition

2023-07-21 · Faisal Hamman, Sanghamitra Dutta

This work presents an information-theoretic perspective to group fairness trade-offs in federated learning (FL) with respect to sensitive attributes, such as gender, race, etc. Existing works often focus on either $\text…

FairnessFederated Learning

Utility-Fairness Trade-Offs and How to Find Them

2024-04-15 · CVPR 2024 1 · Sepehr Dehdashtian, Bashir Sadeghi, Vishnu Naresh Boddeti

When building classification systems with demographic fairness considerations, there are two objectives to satisfy: 1) maximizing utility for the specific task and 2) ensuring fairness w.r.t. a known demographic attribut…

AttributeFairnessRepresentation Learning

Fundamental Limits and Tradeoffs in Invariant Representation Learning

2020-12-19 · NeurIPS 2023 11 · Han Zhao, Chen Dan, Bryon Aragam, Tommi S. Jaakkola 외

A wide range of machine learning applications such as privacy-preserving learning, algorithmic fairness, and domain adaptation/generalization among others, involve learning invariant representations of the data that aim …

Domain AdaptationFairnessInformation PlanePrivacy Preserving+2

Accuracy and Fairness Trade-offs in Machine Learning: A Stochastic Multi-Objective Approach

2020-08-03 · Suyun Liu, Luis Nunes Vicente

In the application of machine learning to real-life decision-making systems, e.g., credit scoring and criminal justice, the prediction outcomes might discriminate against people with sensitive attributes, leading to unfa…

BIG-bench Machine LearningDecision MakingFairness

Fundamental Limits of Obfuscation for Linear Gaussian Dynamical Systems: An Information-Theoretic Approach

2020-10-29 · Song Fang, Quanyan Zhu

In this paper, we study the fundamental limits of obfuscation in terms of privacy-distortion tradeoffs for linear Gaussian dynamical systems via an information-theoretic approach. Particularly, we obtain analytical formu…