paper-with-me

홈 › Papers

HARRIS: Hybrid Ranking and Regression Forests for Algorithm Selection

2022-10-31 · Lukas Fehring, Jonas Hanselle, Alexander Tornede

It is well known that different algorithms perform differently well on an instance of an algorithmic problem, motivating algorithm selection (AS): Given an instance of an algorithmic problem, which is the most suitable algorithm to solve it? As such, the AS problem has received considerable attention resulting in various approaches - many of which either solve a regression or ranking problem under the hood. Although both of these formulations yield very natural ways to tackle AS, they have considerable weaknesses. On the one hand, correctly predicting the performance of an algorithm on an instance is a sufficient, but not a necessary condition to produce a correct ranking over algorithms and in particular ranking the best algorithm first. On the other hand, classical ranking approaches often do not account for concrete performance values available in the training data, but only leverage rankings composed from such data. We propose HARRIS- Hybrid rAnking and RegRessIon foreSts - a new algorithm selector leveraging special forests, combining the strengths of both approaches while alleviating their weaknesses. HARRIS' decisions are based on a forest model, whose trees are created based on splits optimized on a hybrid ranking and regression loss function. As our preliminary experimental study on ASLib shows, HARRIS improves over standard algorithm selection approaches on some scenarios showing that combining ranking and regression in trees is indeed promising for AS.

📄 PDF Abstract BibTeX arXiv:2210.17341

Code (1)

lukasfehring/harris-hybrid_ranking_and_regression_forests 공식 구현

Tasks

regression

Similar Papers 제목 키워드 기반

Label Ranking through Nonparametric Regression

2021-11-04 · Dimitris Fotakis, Alkis Kalavasis, Eleni Psaroudaki

Label Ranking (LR) corresponds to the problem of learning a hypothesis that maps features to rankings over a finite set of labels. We adopt a nonparametric regression approach to LR and obtain theoretical performance gua…

regression

Feature Ranking for Semi-supervised Learning

2020-08-10 · Matej Petković, Sašo Džeroski, Dragi Kocev

The data made available for analysis are becoming more and more complex along several directions: high dimensionality, number of examples and the amount of labels per example. This poses a variety of challenges for the e…

ClassificationGeneral ClassificationHierarchical Multi-label ClassificationMulti-Label Classification+3

An efficient hybrid classification approach for COVID-19 based on Harris Hawks Optimization and Salp Swarm Optimization

2022-12-25 · Abubakr Issa, Yossra Ali, Tarik Rashid

Feature selection can be defined as one of the pre-processing steps that decrease the dimensionality of a dataset by identifying the most significant attributes while also boosting the accuracy of classification. For sol…

feature selection

Self-Paced Deep Regression Forests with Consideration on Underrepresented Examples

2020-04-03 · ECCV 2020 8 · Lili Pan, Shijie Ai, Yazhou Ren, Zenglin Xu

Deep discriminative models (e.g. deep regression forests, deep neural decision forests) have achieved remarkable success recently to solve problems such as facial age estimation and head pose estimation. Most existing me…

Age EstimationFairnessHead Pose EstimationPose Estimation+1

Neural Random Forests

2016-04-25 · Gérard Biau, Erwan Scornet, Johannes Welbl

Given an ensemble of randomized regression trees, it is possible to restructure them as a collection of multilayered neural networks with particular connection weights. Following this principle, we reformulate the random…

regression