paper-with-me

홈 › Papers

Functional Bilevel Optimization for Predictive Fairness

2026-07-06 · Ieva Petrulionyte, Julien Mairal, Michael Arbel arxiv

When sensitive attributes are continuous and high-dimensional $-$ demographic score vectors, posteriors over attributes, age or income profiles $-$ enforcing full statistical independence is often too restrictive, and existing relaxations rely on indirect dependence penalties or adversarial schemes that do not directly target the fairness-accuracy trade-off. We instead consider mean demographic parity through DPVar, the variance of the conditional-mean prediction given the sensitive attribute, and show that optimizing it yields a functional bilevel problem. We propose two algorithms for this problem: FBO, which uses a closed-form adjoint we derive for the squared-loss case to obtain an exact hypergradient, and ITD, which differentiates through unrolled inner steps and extends beyond squared loss. On synthetic data and a new semi-synthetic benchmark built from 60 tabular regression datasets, both methods achieve the lowest or near-lowest aggregate fairness-accuracy regret, and consistently match or outperform strong HSIC, adversarial, linear-dependence, and generalized-DP baselines.

📄 PDF Abstract BibTeX arXiv:2607.05098

Code (0)

등록된 구현이 없습니다.

Tasks

Bilevel Optimization

Similar Papers 제목 키워드 기반

Functional Bilevel Optimization for Machine Learning

2024-03-29 · Ieva Petrulionyte, Julien Mairal, Michael Arbel

In this paper, we introduce a new functional point of view on bilevel optimization problems for machine learning, where the inner objective is minimized over a function space. These types of problems are most often solve…

Bilevel OptimizationPrediction

FairBatch: Batch Selection for Model Fairness

2020-12-03 · ICLR 2021 1 · Yuji Roh, Kangwook Lee, Steven Euijong Whang, Changho Suh

Training a fair machine learning model is essential to prevent demographic disparity. Existing techniques for improving model fairness require broad changes in either data preprocessing or model training, rendering thems…

BIG-bench Machine LearningBilevel OptimizationFairnessmodel

Non-Stationary Functional Bilevel Optimization

2026-01-21 · Jason Bohne, Ieva Petrulionyte, Michael Arbel, Julien Mairal 외 arxiv

Functional bilevel optimization (FBO) provides a powerful framework for hierarchical learning in function spaces, yet current methods are limited to static offline settings and perform suboptimally in online, non-station…

Hyperparameter OptimizationReinforcement LearningBilevel Optimization

Fairness-informed Pareto Optimization : An Efficient Bilevel Framework

2026-01-19 · Sofiane Tanji, Samuel Vaiter, Yassine Laguel arxiv

Despite their promise, fair machine learning methods often yield Pareto-inefficient models, in which the performance of certain groups can be improved without degrading that of others. This issue arises frequently in tra…

Learning Theory for Kernel Bilevel Optimization

2025-02-12 · Fares El Khoury, Edouard Pauwels, Samuel Vaiter, Michael Arbel

Bilevel optimization has emerged as a technique for addressing a wide range of machine learning problems that involve an outer objective implicitly determined by the minimizer of an inner problem. In this paper, we inves…

Bilevel OptimizationLearning Theory