Ensemble Pruning based on Objection Maximization with a General Distributed Framework
Ensemble pruning, selecting a subset of individual learners from an original ensemble, alleviates the deficiencies of ensemble learning on the cost of time and space. Accuracy and diversity serve as two crucial factors while they usually conflict with each other. To balance both of them, we formalize the ensemble pruning problem as an objection maximization problem based on information entropy. Then we propose an ensemble pruning method including a centralized version and a distributed version, in which the latter is to speed up the former. At last, we extract a general distributed framework for ensemble pruning, which can be widely suitable for most of the existing ensemble pruning methods and achieve less time consuming without much accuracy degradation. Experimental results validate the efficiency of our framework and methods, particularly concerning a remarkable improvement of the execution speed, accompanied by gratifying accuracy performance.
Code (1)
Tasks
DiversityEnsemble LearningEnsemble PruningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Ensemble Pruning via Margin Maximization
Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, a…
DiversityEnsemble PruningHierarchical Pruning of Deep Ensembles with Focal Diversity
Deep neural network ensembles combine the wisdom of multiple deep neural networks to improve the generalizability and robustness over individual networks. It has gained increasing popularity to study deep ensemble techni…
Decision MakingDiversityEnsemble PruningBoosting Deep Ensemble Performance with Hierarchical Pruning
Deep neural network ensembles have become attractive learning techniques with better generalizability over individual models. Some mission critical applications may require a large number of deep neural networks to achie…
Decision MakingDiversityEnsemble PruningImage ClassificationOptimally Pruning Decision Tree Ensembles With Feature Cost
We consider the problem of learning decision rules for prediction with feature budget constraint. In particular, we are interested in pruning an ensemble of decision trees to reduce expected feature cost while maintainin…
Ensemble PruningPredictionWhen does Diversity Help Generalization in Classification Ensembles?
Ensembles, as a widely used and effective technique in the machine learning community, succeed within a key element -- "diversity." The relationship between diversity and generalization, unfortunately, is not entirely un…
ClassificationDiversityEnsemble PruningGeneral Classification+1