Regression Phalanxes

2017-07-03 · Hongyang Zhang, William J. Welch, Ruben H. Zamar

Tomal et al. (2015) introduced the notion of "phalanxes" in the context of rare-class detection in two-class classification problems. A phalanx is a subset of features that work well for classification tasks. In this paper, we propose a different class of phalanxes for application in regression settings. We define a "Regression Phalanx" - a subset of features that work well together for prediction. We propose a novel algorithm which automatically chooses Regression Phalanxes from high-dimensional data sets using hierarchical clustering and builds a prediction model for each phalanx for further ensembling. Through extensive simulation studies and several real-life applications in various areas (including drug discovery, chemical analysis of spectra data, microarray analysis and climate projections) we show that an ensemble of Regression Phalanxes improves prediction accuracy when combined with effective prediction methods like Lasso or Random Forests.

📄 PDF Abstract BibTeX arXiv:1707.00727

Code (0)

등록된 구현이 없습니다.

Tasks

ClusteringDrug Discovery General Classification Prediction regression

Ensembles of phalanxes across assessment metrics for robust ranking of homologous proteins

2017-06-21 · Jabed H. Tomal, William J. Welch, Ruben H. Zamar

Two proteins are homologous if they have a common evolutionary origin, and the binary classification problem is to identify proteins in a candidate set that are homologous to a particular native protein. The feature (exp…

Binary Classification General Classification

Ensembling classification models based on phalanxes of variables with applications in drug discovery

2013-03-20 · Jabed H. Tomal, William J. Welch, Ruben H. Zamar

Statistical detection of a rare class of objects in a two-class classification problem can pose several challenges. Because the class of interest is rare in the training data, there is relatively little information in th…

Computational chemistry Drug Discovery General Classification

Evaluating Hospital Case Cost Prediction Models Using Azure Machine Learning Studio

2018-04-04 · Alexei Botchkarev

Ability for accurate hospital case cost modelling and prediction is critical for efficient health care financial management and budgetary planning. A variety of regression machine learning algorithms are known to be effe…

BIG-bench Machine Learning Gaussian Processes Management regression

Robust Regression via Mutivariate Regression Depth

2017-02-15 · Chao Gao

This paper studies robust regression in the settings of Huber's $\epsilon$-contamination models. We consider estimators that are maximizers of multivariate regression depth functions. These estimators are shown to achiev…

regression

How to get the most out of Twinned Regression Methods

2023-01-03 · Sebastian J. Wetzel

Twinned regression methods are designed to solve the dual problem to the original regression problem, predicting differences between regression targets rather then the targets themselves. A solution to the original regre…