Autostacker: A Compositional Evolutionary Learning System
We introduce an automatic machine learning (AutoML) modeling architecture called Autostacker, which combines an innovative hierarchical stacking architecture and an Evolutionary Algorithm (EA) to perform efficient parameter search. Neither prior domain knowledge about the data nor feature preprocessing is needed. Using EA, Autostacker quickly evolves candidate pipelines with high predictive accuracy. These pipelines can be used as is or as a starting point for human experts to build on. Autostacker finds innovative combinations and structures of machine learning models, rather than selecting a single model and optimizing its hyperparameters. Compared with other AutoML systems on fifteen datasets, Autostacker achieves state-of-art or competitive performance both in terms of test accuracy and time cost.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBIG-bench Machine LearningHyperparameter OptimizationSimilar Papers 제목 키워드 기반
Autostacker: an Automatic Evolutionary Hierarchical Machine Learning System
This work provides an automatic machine learning (AutoML) modelling architecture called Autostacker. Autostacker improves the prediction accuracy of machine learning baselines by utilizing an innovative hierarchical stac…
AutoMLBIG-bench Machine LearningDarwinML: A Graph-based Evolutionary Algorithm for Automated Machine Learning
As an emerging field, Automated Machine Learning (AutoML) aims to reduce or eliminate manual operations that require expertise in machine learning. In this paper, a graph-based architecture is employed to represent flexi…
AutoMLBIG-bench Machine LearningAlphaD3M: Machine Learning Pipeline Synthesis
We introduce AlphaD3M, an automatic machine learning (AutoML) system based on meta reinforcement learning using sequence models with self play. AlphaD3M is based on edit operations performed over machine learning pipelin…
AutoMLBIG-bench Machine LearningMeta Reinforcement Learningreinforcement-learning+2Emergence of Compositional Language with Deep Generational Transmission
Recent work has studied the emergence of language among deep reinforcement learning agents that must collaborate to solve a task. Of particular interest are the factors that cause language to be compositional -- i.e., ex…
Deep Reinforcement LearningReinforcement LearningReinforcement Learning (RL)Compositionality and the lexicon in evolutionary semantics
Formal semantics has shown that sentence meanings arise by recursively composing lexical meanings, yet much of the literature on semantic universals models either lexicons with fixed signal structures or holistic composi…