paper-with-me

Papers

Statistical learning for constrained functional parameters in infinite-dimensional models with applications in fair machine learning

2024-04-15 · Razieh Nabi, Nima S. Hejazi, Mark J. Van Der Laan, David Benkeser

Constrained learning has become increasingly important, especially in the realm of algorithmic fairness and machine learning. In these settings, predictive models are developed specifically to satisfy pre-defined notions of fairness. Here, we study the general problem of constrained statistical machine learning through a statistical functional lens. We consider learning a function-valued parameter of interest under the constraint that one or several pre-specified real-valued functional parameters equal zero or are otherwise bounded. We characterize the constrained functional parameter as the minimizer of a penalized risk criterion using a Lagrange multiplier formulation. We show that closed-form solutions for the optimal constrained parameter are often available, providing insight into mechanisms that drive fairness in predictive models. Our results also suggest natural estimators of the constrained parameter that can be constructed by combining estimates of unconstrained parameters of the data generating distribution. Thus, our estimation procedure for constructing fair machine learning algorithms can be applied in conjunction with any statistical learning approach and off-the-shelf software. We demonstrate the generality of our method by explicitly considering a number of examples of statistical fairness constraints and implementing the approach using several popular learning approaches.

📄 PDF Abstract BibTeX arXiv:2404.09847

Code (0)

등록된 구현이 없습니다.

Tasks

Fairness

Similar Papers 제목 키워드 기반

The empirical duality gap of constrained statistical learning

2020-02-12 · Luiz. F. O. Chamon, Santiago Paternain, Miguel Calvo-Fullana, Alejandro Ribeiro

This paper is concerned with the study of constrained statistical learning problems, the unconstrained version of which are at the core of virtually all of modern information processing. Accounting for constraints, howev…

Functional Factor Regression with an Application to Electricity Price Curve Modeling

2025-03-16 · Sven Otto, Luis Winter

We propose a function-on-function linear regression model for time-dependent curve data that is consistently estimated by imposing factor structures on the regressors. An integral operator based on cross-covariances iden…

regressionvalid

Continuous-Time Functional Diffusion Processes

2023-03-01 · NeurIPS 2023 11 · Giulio Franzese, Giulio Corallo, Simone Rossi, Markus Heinonen 외

We introduce Functional Diffusion Processes (FDPs), which generalize score-based diffusion models to infinite-dimensional function spaces. FDPs require a new mathematical framework to describe the forward and backward dy…

Image Generation

Optimization-Based MCMC Methods for Nonlinear Hierarchical Statistical Inverse Problems

2020-02-15 · Johnathan Bardsley, Tiangang Cui

In many hierarchical inverse problems, not only do we want to estimate high- or infinite-dimensional model parameters in the parameter-to-observable maps, but we also have to estimate hyperparameters that represent criti…

Pure Differential Privacy for Functional Summaries via a Laplace-like Process

2023-08-31 · Haotian Lin, Matthew Reimherr

Many existing mechanisms to achieve differential privacy (DP) on infinite-dimensional functional summaries often involve embedding these summaries into finite-dimensional subspaces and applying traditional DP techniques.…