paper-with-me

홈 › Papers

Partition-wise Linear Models

2014-10-31 · NeurIPS 2014 12 · Hidekazu Oiwa, Ryohei Fujimaki

Region-specific linear models are widely used in practical applications because of their non-linear but highly interpretable model representations. One of the key challenges in their use is non-convexity in simultaneous optimization of regions and region-specific models. This paper proposes novel convex region-specific linear models, which we refer to as partition-wise linear models. Our key ideas are 1) assigning linear models not to regions but to partitions (region-specifiers) and representing region-specific linear models by linear combinations of partition-specific models, and 2) optimizing regions via partition selection from a large number of given partition candidates by means of convex structured regularizations. In addition to providing initialization-free globally-optimal solutions, our convex formulation makes it possible to derive a generalization bound and to use such advanced optimization techniques as proximal methods and decomposition of the proximal maps for sparsity-inducing regularizations. Experimental results demonstrate that our partition-wise linear models perform better than or are at least competitive with state-of-the-art region-specific or locally linear models.

📄 PDF Abstract BibTeX arXiv:1410.8675

Code (0)

등록된 구현이 없습니다.

Similar Papers 제목 키워드 기반

Manifold Partition Discriminant Analysis

2020-11-23 · Yang Zhou, Shiliang Sun

We propose a novel algorithm for supervised dimensionality reduction named Manifold Partition Discriminant Analysis (MPDA). It aims to find a linear embedding space where the within-class similarity is achieved along the…

Dimensionality ReductionSupervised dimensionality reduction

A Comprehensive Approach to Universal Piecewise Nonlinear Regression Based on Trees

2013-11-25 · N. Denizcan Vanli, Suleyman S. Kozat

In this paper, we investigate adaptive nonlinear regression and introduce tree based piecewise linear regression algorithms that are highly efficient and provide significantly improved performance with guaranteed upper b…

regression

Discrete minimax estimation with trees

2018-12-14 · Luc Devroye, Tommy Reddad

We propose a simple recursive data-based partitioning scheme which produces piecewise-constant or piecewise-linear density estimates on intervals, and show how this scheme can determine the optimal $L_1$ minimax rate for…

Extensions of Morse-Smale Regression with Application to Actuarial Science

2017-08-17 · Colleen M. Farrelly

The problem of subgroups is ubiquitous in scientific research (ex. disease heterogeneity, spatial distributions in ecology...), and piecewise regression is one way to deal with this phenomenon. Morse-Smale regression off…

BIG-bench Machine Learningregression

K-Plane Regression

2012-11-07 · Naresh Manwani, P. S. Sastry

In this paper, we present a novel algorithm for piecewise linear regression which can learn continuous as well as discontinuous piecewise linear functions. The main idea is to repeatedly partition the data and learn a li…

Clusteringregression