Enhancing binary classification: A new stacking method via leveraging computational geometry
Stacking, a potent ensemble learning method, leverages a meta-model to harness the strengths of multiple base models, thereby enhancing prediction accuracy. Traditional stacking techniques typically utilize established learning models, such as logistic regression, as the meta-model. This paper introduces a novel approach that integrates computational geometry techniques, specifically solving the maximum weighted rectangle problem, to develop a new meta-model for binary classification. Our method is evaluated on multiple open datasets, with statistical analysis showing its stability and demonstrating improvements in accuracy compared to current state-of-the-art stacking methods with out-of-fold predictions. This new stacking method also boasts two significant advantages: enhanced interpretability and the elimination of hyperparameter tuning for the meta-model, thus increasing its practicality. These merits make our method highly applicable not only in stacking ensemble learning but also in various real-world applications, such as hospital health evaluation scoring and bank credit scoring systems, offering a fresh evaluation perspective.
Code (0)
등록된 구현이 없습니다.
Tasks
Binary ClassificationEnsemble LearningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Multilabel Classification with R Package mlr
We implemented several multilabel classification algorithms in the machine learning package mlr. The implemented methods are binary relevance, classifier chains, nested stacking, dependent binary relevance and stacking, …
BIG-bench Machine LearningClassificationGeneral ClassificationEnhancing Edge Intelligence with Highly Discriminant LNT Features
AI algorithms at the edge demand smaller model sizes and lower computational complexity. To achieve these objectives, we adopt a green learning (GL) paradigm rather than the deep learning paradigm. GL has three modules: …
Binary ClassificationRepresentation LearningStacking-Enhanced Bagging Ensemble Learning for Breast Cancer Classification with CNN
This paper proposes a CNN classification network based on Bagging and stacking ensemble learning methods for breast cancer classification. The model was trained and tested on the public dataset of DDSM. The model is capa…
Binary ClassificationCancer ClassificationClassificationEnsemble Learningpystacked: Stacking generalization and machine learning in Stata
pystacked implements stacked generalization (Wolpert, 1992) for regression and binary classification via Python's scikit-learn. Stacking combines multiple supervised machine learners -- the "base" or "level-0" learners -…
Binary ClassificationregressionEnsemble Models for Detecting Wikidata Vandalism with Stacking - Team Honeyberry Vandalism Detector at WSDM Cup 2017
The WSDM Cup 2017 is a binary classification task for classifying Wikidata revisions into vandalism and non-vandalism. This paper describes our method using some machine learning techniques such as under-sampling, featur…
BIG-bench Machine LearningBinary Classificationfeature selection