paper-with-me

Papers

Kernel Dependence Regularizers and Gaussian Processes with Applications to Algorithmic Fairness

2019-11-11 · Zhu Li, Adrian Perez-Suay, Gustau Camps-Valls, Dino Sejdinovic

Current adoption of machine learning in industrial, societal and economical activities has raised concerns about the fairness, equity and ethics of automated decisions. Predictive models are often developed using biased datasets and thus retain or even exacerbate biases in their decisions and recommendations. Removing the sensitive covariates, such as gender or race, is insufficient to remedy this issue since the biases may be retained due to other related covariates. We present a regularization approach to this problem that trades off predictive accuracy of the learned models (with respect to biased labels) for the fairness in terms of statistical parity, i.e. independence of the decisions from the sensitive covariates. In particular, we consider a general framework of regularized empirical risk minimization over reproducing kernel Hilbert spaces and impose an additional regularizer of dependence between predictors and sensitive covariates using kernel-based measures of dependence, namely the Hilbert-Schmidt Independence Criterion (HSIC) and its normalized version. This approach leads to a closed-form solution in the case of squared loss, i.e. ridge regression. Moreover, we show that the dependence regularizer has an interpretation as modifying the corresponding Gaussian process (GP) prior. As a consequence, a GP model with a prior that encourages fairness to sensitive variables can be derived, allowing principled hyperparameter selection and studying of the relative relevance of covariates under fairness constraints. Experimental results in synthetic examples and in real problems of income and crime prediction illustrate the potential of the approach to improve fairness of automated decisions.

📄 PDF Abstract BibTeX arXiv:1911.04322

Code (0)

등록된 구현이 없습니다.

Tasks

Crime PredictionEthicsFairnessGaussian Processes

Methods 이 논문이 사용한 방법론

Gaussian Process Gaussian Processes are non-parametric models for approximating functions. They rely upon a measure of similarity between points (the kernel function) to predict the value for…

Similar Papers 제목 키워드 기반

Gaussian Processes and Reproducing Kernels: Connections and Equivalences

2025-06-20 · Motonobu Kanagawa, Philipp Hennig, Dino Sejdinovic, Bharath K. Sriperumbudur

This monograph studies the relations between two approaches using positive definite kernels: probabilistic methods using Gaussian processes, and non-probabilistic methods using reproducing kernel Hilbert spaces (RKHS). T…

Gaussian ProcessesNumerical Integration

Non-separable Covariance Kernels for Spatiotemporal Gaussian Processes based on a Hybrid Spectral Method and the Harmonic Oscillator

2023-02-19 · Dionissios T. Hristopulos

Gaussian processes provide a flexible, non-parametric framework for the approximation of functions in high-dimensional spaces. The covariance kernel is the main engine of Gaussian processes, incorporating correlations th…

Computational EfficiencyGaussian Processes

A Fast Kernel-based Conditional Independence test with Application to Causal Discovery

2025-05-16 · Oliver Schacht, Biwei Huang

Kernel-based conditional independence (KCI) testing is a powerful nonparametric method commonly employed in causal discovery tasks. Despite its flexibility and statistical reliability, cubic computational complexity limi…

Causal DiscoveryCausal InferenceGaussian ProcessesMixture-of-Experts

DAG-GPs: Learning Directed Acyclic Graph Structure For Multi-Output Gaussian Processes

2021-01-01 · Benjamin J. Ayton, Brian Williams

Multi-output Gaussian processes (MOGPs) introduce correlations between outputs, but are subject to negative transfer, where learned correlations associate an output with another that is actually unrelated, leading to dim…

Gaussian Processes

Imitation Learning of Neural Spatio-Temporal Point Processes

2019-06-13 · Shixiang Zhu, Shuang Li, Zhigang Peng, Yao Xie

We present a novel Neural Embedding Spatio-Temporal (NEST) point process model for spatio-temporal discrete event data and develop an efficient imitation learning (a type of reinforcement learning) based approach for mod…

Computational EfficiencyImitation LearningPoint Processes