Autostacker: an Automatic Evolutionary Hierarchical Machine Learning System
This work provides an automatic machine learning (AutoML) modelling architecture called Autostacker. Autostacker improves the prediction accuracy of machine learning baselines by utilizing an innovative hierarchical stacking architecture and an efficient parameter search algorithm. Neither prior domain knowledge about the data nor feature preprocessing is needed. We significantly reduce the time of AutoML with a naturally inspired algorithm - Parallel Hill Climbing (PHC). By parallelizing PHC, Autostacker can provide candidate pipelines with sufficient prediction accuracy within a short amount of time. These pipelines can be used as is or as a starting point for human experts to build on. By focusing on the modelling process, Autostacker breaks the tradition of following fixed order pipelines by exploring not only single model pipeline but also innovative combinations and structures. As we will show in the experiment section, Autostacker achieves significantly better performance both in terms of test accuracy and time cost comparing with human initial trials and recent popular AutoML system.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Autostacker: A Compositional Evolutionary Learning System
We introduce an automatic machine learning (AutoML) modeling architecture called Autostacker, which combines an innovative hierarchical stacking architecture and an Evolutionary Algorithm (EA) to perform efficient parame…
AutoMLBIG-bench Machine LearningHyperparameter OptimizationAlphaD3M: Machine Learning Pipeline Synthesis
We introduce AlphaD3M, an automatic machine learning (AutoML) system based on meta reinforcement learning using sequence models with self play. AlphaD3M is based on edit operations performed over machine learning pipelin…
AutoMLBIG-bench Machine LearningMeta Reinforcement Learningreinforcement-learning+2DarwinML: A Graph-based Evolutionary Algorithm for Automated Machine Learning
As an emerging field, Automated Machine Learning (AutoML) aims to reduce or eliminate manual operations that require expertise in machine learning. In this paper, a graph-based architecture is employed to represent flexi…
AutoMLBIG-bench Machine LearningBenchmark of structured machine learning methods for microbial identification from mass-spectrometry data
Microbial identification is a central issue in microbiology, in particular in the fields of infectious diseases diagnosis and industrial quality control. The concept of species is tightly linked to the concept of biologi…
BIG-bench Machine LearningAutomatic selection of primary studies in systematic reviews with evolutionary rule-based classification
Searching, filtering and analysing scientific literature are time-consuming tasks when performing a systematic literature review. With the rise of artificial intelligence, some steps in the review process are progressive…