Personalized Classifier Ensemble Pruning Framework for Mobile Crowdsourcing
Ensemble learning has been widely employed by mobile applications, ranging from environmental sensing to activity recognitions. One of the fundamental issue in ensemble learning is the trade-off between classification accuracy and computational costs, which is the goal of ensemble pruning. During crowdsourcing, the centralized aggregator releases ensemble learning models to a large number of mobile participants for task evaluation or as the crowdsourcing learning results, while different participants may seek for different levels of the accuracy-cost trade-off. However, most of existing ensemble pruning approaches consider only one identical level of such trade-off. In this study, we present an efficient ensemble pruning framework for personalized accuracy-cost trade-offs via multi-objective optimization. Specifically, for the commonly used linear-combination style of the trade-off, we provide an objective-mixture optimization to further reduce the number of ensemble candidates. Experimental results show that our framework is highly efficient for personalized ensemble pruning, and achieves much better pruning performance with objective-mixture optimization when compared to state-of-art approaches.
Code (0)
등록된 구현이 없습니다.
Tasks
Ensemble LearningEnsemble PruningMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
On-the-Fly Ensemble Pruning in Evolving Data Streams
Ensemble pruning is the process of selecting a subset of componentclassifiers from an ensemble which performs at least as well as theoriginal ensemble while reducing storage and computational costs.Ensemble pruning in da…
Ensemble PruningEnsemble pruning via an integer programming approach with diversity constraints
Ensemble learning combines multiple classifiers in the hope of obtaining better predictive performance. Empirical studies have shown that ensemble pruning, that is, choosing an appropriate subset of the available classif…
Binary ClassificationDiversityEnsemble LearningEnsemble PruningResearch on Personalized Compression Algorithm for Pre-trained Models Based on Homomorphic Entropy Increase
In this article, we explore the challenges and evolution of two key technologies in the current field of AI: Vision Transformer model and Large Language Model (LLM). Vision Transformer captures global information by spli…
compressed sensingLanguage ModelingLanguage ModellingLarge Language ModelEnsemble Pruning via Margin Maximization
Ensemble models refer to methods that combine a typically large number of classifiers into a compound prediction. The output of an ensemble method is the result of fitting a base-learning algorithm to a given data set, a…
DiversityEnsemble PruningLiquid Democracy for Low-Cost Ensemble Pruning
We argue that there is a strong connection between ensemble learning and a delegative voting paradigm -- liquid democracy -- that can be leveraged to reduce ensemble training costs. We present an incremental training pro…
Ensemble LearningEnsemble Pruning