paper-with-me

Papers

Fair Adversarial Gradient Tree Boosting

2019-11-13 · Vincent Grari, Boris Ruf, Sylvain Lamprier, Marcin Detyniecki

Fair classification has become an important topic in machine learning research. While most bias mitigation strategies focus on neural networks, we noticed a lack of work on fair classifiers based on decision trees even though they have proven very efficient. In an up-to-date comparison of state-of-the-art classification algorithms in tabular data, tree boosting outperforms deep learning. For this reason, we have developed a novel approach of adversarial gradient tree boosting. The objective of the algorithm is to predict the output $Y$ with gradient tree boosting while minimizing the ability of an adversarial neural network to predict the sensitive attribute $S$. The approach incorporates at each iteration the gradient of the neural network directly in the gradient tree boosting. We empirically assess our approach on 4 popular data sets and compare against state-of-the-art algorithms. The results show that our algorithm achieves a higher accuracy while obtaining the same level of fairness, as measured using a set of different common fairness definitions.

📄 PDF Abstract BibTeX arXiv:1911.05369

Code (1)

vincent-grari/FAGTB pytorch

Tasks

AttributeFairnessGeneral Classification

Similar Papers 제목 키워드 기반

Individually Fair Gradient Boosting

2021-03-31 · ICLR 2021 1 · Alexander Vargo, Fan Zhang, Mikhail Yurochkin, Yuekai Sun

We consider the task of enforcing individual fairness in gradient boosting. Gradient boosting is a popular method for machine learning from tabular data, which arise often in applications where algorithmic fairness is a …

Fairness

FairGBM: Gradient Boosting with Fairness Constraints

2022-09-16 · André F Cruz, Catarina Belém, Sérgio Jesus, João Bravo 외

Tabular data is prevalent in many high-stakes domains, such as financial services or public policy. Gradient Boosted Decision Trees (GBDT) are popular in these settings due to their scalability, performance, and low trai…

Decision MakingFairness

A Fast Sampling Gradient Tree Boosting Framework

2019-11-20 · Daniel Chao Zhou, Zhongming Jin, Tong Zhang

As an adaptive, interpretable, robust, and accurate meta-algorithm for arbitrary differentiable loss functions, gradient tree boosting is one of the most popular machine learning techniques, though the computational expe…

Robust Boosting Forests with Richer Deep Feature Hierarchy

2022-10-29 · Jianqiao Wangni

We propose a robust variant of boosting forest to the various adversarial defense methods, and apply it to enhance the robustness of the deep neural network. We retain the deep network architecture, weights, and middle l…

Adversarial DefenseFace Model

Gradient boosting machine with partially randomized decision trees

2020-06-19 · Andrei V. Konstantinov, Lev V. Utkin

The gradient boosting machine is a powerful ensemble-based machine learning method for solving regression problems. However, one of the difficulties of its using is a possible discontinuity of the regression function, wh…

BIG-bench Machine Learningregression