Sparse High-Dimensional Isotonic Regression

2019-12-01 · NeurIPS 2019 12 · David Gamarnik, Julia Gaudio

We consider the problem of estimating an unknown coordinate-wise monotone function given noisy measurements, known as the isotonic regression problem. Often, only a small subset of the features affects the output. This motivates the sparse isotonic regression setting, which we consider here. We provide an upper bound on the expected VC entropy of the space of sparse coordinate-wise monotone functions, and identify the regime of statistical consistency of our estimator. We also propose a linear program to recover the active coordinates, and provide theoretical recovery guarantees. We close with experiments on cancer classification, and show that our method significantly outperforms several standard methods.

📄 PDF Abstract BibTeX

Code (0)

등록된 구현이 없습니다.

Tasks

Cancer Classification regression Vocal Bursts Intensity Prediction

Sparse Linear Isotonic Models

2017-10-16 · Sheng Chen, Arindam Banerjee

In machine learning and data mining, linear models have been widely used to model the response as parametric linear functions of the predictors. To relax such stringent assumptions made by parametric linear models, addit…

Additive models

Beyond Additivity: Sparse Isotonic Shapley Regression toward Nonlinear Explainability

2025-12-02 · Jialai She arxiv

Shapley values, a gold standard for feature attribution in Explainable AI, face two key challenges. First, the canonical Shapley framework assumes that the worth function is additive, yet real-world payoff constructions-…

Computational Efficiency

Efficient Algorithms for Non-convex Isotonic Regression through Submodular Optimization

2017-07-28 · NeurIPS 2018 12 · Francis Bach

We consider the minimization of submodular functions subject to ordering constraints. We show that this optimization problem can be cast as a convex optimization problem on a space of uni-dimensional measures, with order…

regression

Efficient Learning of Generalized Linear and Single Index Models with Isotonic Regression

2011-12-01 · NeurIPS 2011 12 · Sham M. Kakade, Varun Kanade, Ohad Shamir, Adam Kalai

Generalized Linear Models (GLMs) and Single Index Models (SIMs) provide powerful generalizations of linear regression, where the target variable is assumed to be a (possibly unknown) 1-dimensional function of a linear pr…

regression

Classifier Calibration with ROC-Regularized Isotonic Regression

2023-11-21 · Eugene Berta, Francis Bach, Michael Jordan

Calibration of machine learning classifiers is necessary to obtain reliable and interpretable predictions, bridging the gap between model confidence and actual probabilities. One prominent technique, isotonic regression …

Classifier calibration regression