paper-with-me

Papers

Piecewise linear regression and classification

2021-03-10 · Alberto Bemporad

This paper proposes a method for solving multivariate regression and classification problems using piecewise linear predictors over a polyhedral partition of the feature space. The resulting algorithm that we call PARC (Piecewise Affine Regression and Classification) alternates between (i) solving ridge regression problems for numeric targets, softmax regression problems for categorical targets, and either softmax regression or cluster centroid computation for piecewise linear separation, and (ii) assigning the training points to different clusters on the basis of a criterion that balances prediction accuracy and piecewise-linear separability. We prove that PARC is a block-coordinate descent algorithm that optimizes a suitably constructed objective function, and that it converges in a finite number of steps to a local minimum of that function. The accuracy of the algorithm is extensively tested numerically on synthetic and real-world datasets, showing that the approach provides an extension of linear regression/classification that is particularly useful when the obtained predictor is used as part of an optimization model. A Python implementation of the algorithm described in this paper is available at http://cse.lab.imtlucca.it/~bemporad/parc .

📄 PDF Abstract BibTeX arXiv:2103.06189

Code (0)

등록된 구현이 없습니다.

Tasks

ClassificationGeneral Classificationregression

Methods 이 논문이 사용한 방법론

Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…

Similar Papers 제목 키워드 기반

Piecewise Linear Regression via a Difference of Convex Functions

2020-07-05 · ICML 2020 1 · Ali Siahkamari, Aditya Gangrade, Brian Kulis, Venkatesh Saligrama

We present a new piecewise linear regression methodology that utilizes fitting a difference of convex functions (DC functions) to the data. These are functions $f$ that may be represented as the difference $\phi_1 - \phi…

regression

Gaussian Process Model for Estimating Piecewise Continuous Regression Functions

2021-04-13 · Chiwoo Park

This paper presents a Gaussian process (GP) model for estimating piecewise continuous regression functions. In scientific and engineering applications of regression analysis, the underlying regression functions are piece…

regression

Efficient Regularized Piecewise-Linear Regression Trees

2019-06-29 · Leonidas Lefakis, Oleksandr Zadorozhnyi, Gilles Blanchard

We present a detailed analysis of the class of regression decision tree algorithms which employ a regulized piecewise-linear node-splitting criterion and have regularized linear models at the leaves. From a theoretic sta…

GPUregressionVariable Selection

CLARITree: Cholesky and Lookahead Accelerations for Regression with Interpretable Piecewise Linear Trees

2026-06-11 · Yixiao Wang, Hayden McTavish, Varun Babbar, Margo Seltzer 외 arxiv

Regression trees are among the most interpretable yet expressive model classes in machine learning. Historically, greedy induction has been the dominant approach for constructing well-performing regression trees. While o…

Computational Efficiency

Bayesian Additive Regression Trees with Model Trees

2020-06-12 · Estevão B. Prado, Rafael A. Moral, Andrew C. Parnell

Bayesian Additive Regression Trees (BART) is a tree-based machine learning method that has been successfully applied to regression and classification problems. BART assumes regularisation priors on a set of trees that wo…

modelregression