paper-with-me

홈 › Papers

Fair Sparse Regression with Clustering: An Invex Relaxation for a Combinatorial Problem

2021-02-19 · NeurIPS 2021 12 · Adarsh Barik, Jean Honorio

In this paper, we study the problem of fair sparse regression on a biased dataset where bias depends upon a hidden binary attribute. The presence of a hidden attribute adds an extra layer of complexity to the problem by combining sparse regression and clustering with unknown binary labels. The corresponding optimization problem is combinatorial, but we propose a novel relaxation of it as an \emph{invex} optimization problem. To the best of our knowledge, this is the first invex relaxation for a combinatorial problem. We show that the inclusion of the debiasing/fairness constraint in our model has no adverse effect on the performance. Rather, it enables the recovery of the hidden attribute. The support of our recovered regression parameter vector matches exactly with the true parameter vector. Moreover, we simultaneously solve the clustering problem by recovering the exact value of the hidden attribute for each sample. Our method uses carefully constructed primal dual witnesses to provide theoretical guarantees for the combinatorial problem. To that end, we show that the sample complexity of our method is logarithmic in terms of the dimension of the regression parameter vector.

📄 PDF Abstract BibTeX arXiv:2102.09704

Code (0)

등록된 구현이 없습니다.

Tasks

AttributeClusteringFairnessregression

Similar Papers 제목 키워드 기반

Sparse Mixed Linear Regression with Guarantees: Taming an Intractable Problem with Invex Relaxation

2022-06-02 · Adarsh Barik, Jean Honorio

In this paper, we study the problem of sparse mixed linear regression on an unlabeled dataset that is generated from linear measurements from two different regression parameter vectors. Since the data is unlabeled, our t…

regression

Outlier-robust Estimation of a Sparse Linear Model Using Invexity

2023-06-22 · Adarsh Barik, Jean Honorio

In this paper, we study problem of estimating a sparse regression vector with correct support in the presence of outlier samples. The inconsistency of lasso-type methods is well known in this scenario. We propose a combi…

regression

Learning Binary Trees via Sparse Relaxation

2020-09-28 · Valentina Zantedeschi, Matt Kusner, Vlad Niculae

One of the most classical problems in machine learning is how to learn binary trees that split data into meaningful partitions. From classification/regression via decision trees to hierarchical clustering, binary trees a…

Clusteringregression

Input Invex Neural Network

2021-06-16 · Suman Sapkota, Binod Bhattarai

Connected decision boundaries are useful in several tasks like image segmentation, clustering, alpha-shape or defining a region in nD-space. However, the machine learning literature lacks methods for generating connected…

Image ClassificationImage SegmentationSemantic Segmentation

Optimal Cross-Validation for Sparse Linear Regression

2023-06-26 · Ryan Cory-Wright, Andrés Gómez

Given a high-dimensional covariate matrix and a response vector, ridge-regularized sparse linear regression selects a subset of features that explains the relationship between covariates and the response in an interpreta…

regression