Can AutoML outperform humans? An evaluation on popular OpenML datasets using AutoML Benchmark

2020-09-03 · Marc Hanussek, Matthias Blohm, Maximilien Kintz

In the last few years, Automated Machine Learning (AutoML) has gained much attention. With that said, the question arises whether AutoML can outperform results achieved by human data scientists. This paper compares four AutoML frameworks on 12 different popular datasets from OpenML; six of them supervised classification tasks and the other six supervised regression ones. Additionally, we consider a real-life dataset from one of our recent projects. The results show that the automated frameworks perform better or equal than the machine learning community in 7 out of 12 OpenML tasks.

📄 PDF Abstract BibTeX arXiv:2009.01564

Code (0)

등록된 구현이 없습니다.

Tasks

AutoML BIG-bench Machine Learning regression

Assembled-OpenML: Creating Efficient Benchmarks for Ensembles in AutoML with OpenML

2023-07-01 · Lennart Purucker, Joeran Beel

Automated Machine Learning (AutoML) frameworks regularly use ensembles. Developers need to compare different ensemble techniques to select appropriate techniques for an AutoML framework from the many potential techniques…

AutoML Prediction

AutoGluon-Tabular: Robust and Accurate AutoML for Structured Data

2020-03-13 · Nick Erickson, Jonas Mueller, Alexander Shirkov, Hang Zhang 외

We introduce AutoGluon-Tabular, an open-source AutoML framework that requires only a single line of Python to train highly accurate machine learning models on an unprocessed tabular dataset such as a CSV file. Unlike exi…

AutoML Molecular Property Prediction Neural Architecture Search

Learning meta-features for AutoML

2021-09-29 · ICLR 2022 4 · Herilalaina Rakotoarison, Louisot Milijaona, Andry Rasoanaivo, Michele Sebag 외

This paper tackles the AutoML problem, aimed to automatically select an ML algorithm and its hyper-parameter configuration most appropriate to the dataset at hand. The proposed approach, MetaBu, learns new meta-features …

AutoML

Task Selection for AutoML System Evaluation

2022-08-26 · Jonathan Lorraine, Nihesh Anderson, Chansoo Lee, Quentin de Laroussilhe 외

Our goal is to assess if AutoML system changes - i.e., to the search space or hyperparameter optimization - will improve the final model's performance on production tasks. However, we cannot test the changes on productio…

AutoML Hyperparameter Optimization

LightAutoML: AutoML Solution for a Large Financial Services Ecosystem

2021-09-03 · Anton Vakhrushev, Alexander Ryzhkov, Maxim Savchenko, Dmitry Simakov 외

We present an AutoML system called LightAutoML developed for a large European financial services company and its ecosystem satisfying the set of idiosyncratic requirements that this ecosystem has for AutoML solutions. Ou…