Automatic Frankensteining: Creating Complex Ensembles Autonomously
Automating machine learning by providing techniques that autonomously find the best algorithm, hyperparameter configuration and preprocessing is helpful for both researchers and practitioners. Therefore, it is not surprising that automated machine learning has become a very interesting field of research. While current research is mainly focusing on finding good pairs of algorithms and hyperparameter configurations, we will present an approach that automates the process of creating a top performing ensemble of several layers, different algorithms and hyperparameter configurations. These kinds of ensembles are called jokingly Frankenstein ensembles and proved their benefit on versatile data sets in many machine learning challenges. We compare our approach Automatic Frankensteining with the current state of the art for automated machine learning on 80 different data sets and can show that it outperforms them on the majority using the same training time. Furthermore, we compare Automatic Frankensteining on a large scale data set to more than 3,500 machine learning expert teams and are able to outperform more than 3,000 of them within 12 CPU hours.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBIG-bench Machine LearningCPUSimilar Papers 제목 키워드 기반
Autonomous Learning of Generative Models with Chemical Reaction Network Ensembles
Can a micron sized sack of interacting molecules autonomously learn an internal model of a complex and fluctuating environment? We draw insights from control theory, machine learning theory, chemical reaction network the…
FormLearning TheoryAutomatic Readability Assessment of German Sentences with Transformer Ensembles
Reliable methods for automatic readability assessment have the potential to impact a variety of fields, ranging from machine translation to self-informed learning. Recently, large language models for the German language …
Lexical Complexity PredictionText Complexity Assessment (GermEval 2022)Forming Ensembles at Runtime: A Machine Learning Approach
Smart system applications (SSAs) built on top of cyber-physical and socio-technical systems are increasingly composed of components that can work both autonomously and by cooperating with each other. Cooperating robots, …
BIG-bench Machine LearningSnapE -- Training Snapshot Ensembles of Link Prediction Models
Snapshot ensembles have been widely used in various fields of prediction. They allow for training an ensemble of prediction models at the cost of training a single one. They are known to yield more robust predictions by …
Knowledge GraphsLink PredictionPredictionRobust Few-Shot Ensemble Learning with Focal Diversity-Based Pruning
This paper presents FusionShot, a focal diversity optimized few-shot ensemble learning approach for boosting the robustness and generalization performance of pre-trained few-shot models. The paper makes three original co…
DiversityEnsemble LearningEnsemble PruningFew-Shot Learning