paper-with-me

홈 › Papers

Ensemble Squared: A Meta AutoML System

2020-12-10 · Jason Yoo, Tony Joseph, Dylan Yung, S. Ali Nasseri, Frank Wood

There are currently many barriers that prevent non-experts from exploiting machine learning solutions ranging from the lack of intuition on statistical learning techniques to the trickiness of hyperparameter tuning. Such barriers have led to an explosion of interest in automated machine learning (AutoML), whereby an off-the-shelf system can take care of many of the steps for end-users without the need for expertise in machine learning. This paper presents Ensemble Squared (Ensemble$^2$), an AutoML system that ensembles the results of state-of-the-art open-source AutoML systems. Ensemble$^2$ exploits the diversity of existing AutoML systems by leveraging the differences in their model search space and heuristics. Empirically, we show that diversity of each AutoML system is sufficient to justify ensembling at the AutoML system level. In demonstrating this, we also establish new state-of-the-art AutoML results on the OpenML tabular classification benchmark.

📄 PDF Abstract BibTeX arXiv:2012.05390

Code (0)

등록된 구현이 없습니다.

Tasks

AutoMLBIG-bench Machine LearningDiversitytabular-classification

Similar Papers 제목 키워드 기반

Assembled-OpenML: Creating Efficient Benchmarks for Ensembles in AutoML with OpenML

2023-07-01 · Lennart Purucker, Joeran Beel

Automated Machine Learning (AutoML) frameworks regularly use ensembles. Developers need to compare different ensemble techniques to select appropriate techniques for an AutoML framework from the many potential techniques…

AutoMLPrediction

A Scalable AutoML Approach Based on Graph Neural Networks

2021-10-29 · Mossad Helali, Essam Mansour, Ibrahim Abdelaziz, Julian Dolby 외

AutoML systems build machine learning models automatically by performing a search over valid data transformations and learners, along with hyper-parameter optimization for each learner. Many AutoML systems use meta-learn…

AutoMLGraph GenerationMeta-Learningvalid

Auto-Sklearn 2.0: Hands-free AutoML via Meta-Learning

2020-07-08 · Matthias Feurer, Katharina Eggensperger, Stefan Falkner, Marius Lindauer 외

Automated Machine Learning (AutoML) supports practitioners and researchers with the tedious task of designing machine learning pipelines and has recently achieved substantial success. In this paper, we introduce new Auto…

AutoMLBIG-bench Machine LearningMeta-Learning

AutoML using Metadata Language Embeddings

2019-10-08 · Iddo Drori, Lu Liu, Yi Nian, Sharath C. Koorathota 외

As a human choosing a supervised learning algorithm, it is natural to begin by reading a text description of the dataset and documentation for the algorithms you might use. We demonstrate that the same idea improves the …

AutoML

AutoML in Heavily Constrained Applications

2023-06-29 · Felix Neutatz, Marius Lindauer, Ziawasch Abedjan

Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training datas…

AutoMLMeta-Learning