paper-with-me

Papers

Efficient algorithms for multivariate shape-constrained convex regression problems

2020-02-26 · Meixia Lin, Defeng Sun, Kim-Chuan Toh

Shape-constrained convex regression problem deals with fitting a convex function to the observed data, where additional constraints are imposed, such as component-wise monotonicity and uniform Lipschitz continuity. This paper provides a comprehensive mechanism for computing the least squares estimator of a multivariate shape-constrained convex regression function in $\mathbb{R}^d$. We prove that the least squares estimator is computable via solving a constrained convex quadratic programming (QP) problem with $(n+1)d$ variables and at least $n(n-1)$ linear inequality constraints, where $n$ is the number of data points. For solving the generally very large-scale convex QP, we design two efficient algorithms, one is the symmetric Gauss-Seidel based alternating direction method of multipliers ({\tt sGS-ADMM}), and the other is the proximal augmented Lagrangian method ({\tt pALM}) with the subproblems solved by the semismooth Newton method ({\tt SSN}). Comprehensive numerical experiments, including those in the pricing of basket options and estimation of production functions in economics, demonstrate that both of our proposed algorithms outperform the state-of-the-art algorithm. The {\tt pALM} is more efficient than the {\tt sGS-ADMM} but the latter has the advantage of being simpler to implement.

📄 PDF Abstract BibTeX arXiv:2002.11410

Code (0)

등록된 구현이 없습니다.

Tasks

regression

Similar Papers 제목 키워드 기반

Subgradient Regularized Multivariate Convex Regression at Scale

2020-05-23 · Wenyu Chen, Rahul Mazumder

We present new large-scale algorithms for fitting a subgradient regularized multivariate convex regression function to $n$ samples in $d$ dimensions -- a key problem in shape constrained nonparametric regression with app…

regression

Using Shape Constraints for Improving Symbolic Regression Models

2021-07-20 · Christian Haider, Fabricio Olivetti de França, Bogdan Burlacu, Gabriel Kronberger

We describe and analyze algorithms for shape-constrained symbolic regression, which allows the inclusion of prior knowledge about the shape of the regression function. This is relevant in many areas of engineering -- in …

regressionSymbolic Regression

Efficient Second-Order Shape-Constrained Function Fitting

2019-05-06 · David Durfee, Yu Gao, Anup B. Rao, Sebastian Wild

We give an algorithm to compute a one-dimensional shape-constrained function that best fits given data in weighted-$L_{\infty}$ norm. We give a single algorithm that works for a variety of commonly studied shape constrai…

Comparing Shape-Constrained Regression Algorithms for Data Validation

2022-09-20 · Florian Bachinger, Gabriel Kronberger

Industrial and scientific applications handle large volumes of data that render manual validation by humans infeasible. Therefore, we require automated data validation approaches that are able to consider the prior knowl…

regression

Prediction Rule Reshaping

2018-05-16 · ICML 2018 7 · Matt Bonakdarpour, Sabyasachi Chatterjee, Rina Foygel Barber, John Lafferty

Two methods are proposed for high-dimensional shape-constrained regression and classification. These methods reshape pre-trained prediction rules to satisfy shape constraints like monotonicity and convexity. The first me…

General ClassificationPredictionregression