paper-with-me

홈 › Papers

AutoML to Date and Beyond: Challenges and Opportunities

2020-10-21 · Shubhra Kanti Karmaker Santu, Md. Mahadi Hassan, Micah J. Smith, Lei Xu, ChengXiang Zhai, Kalyan Veeramachaneni

As big data becomes ubiquitous across domains, and more and more stakeholders aspire to make the most of their data, demand for machine learning tools has spurred researchers to explore the possibilities of automated machine learning (AutoML). AutoML tools aim to make machine learning accessible for non-machine learning experts (domain experts), to improve the efficiency of machine learning, and to accelerate machine learning research. But although automation and efficiency are among AutoML's main selling points, the process still requires human involvement at a number of vital steps, including understanding the attributes of domain-specific data, defining prediction problems, creating a suitable training data set, and selecting a promising machine learning technique. These steps often require a prolonged back-and-forth that makes this process inefficient for domain experts and data scientists alike, and keeps so-called AutoML systems from being truly automatic. In this review article, we introduce a new classification system for AutoML systems, using a seven-tiered schematic to distinguish these systems based on their level of autonomy. We begin by describing what an end-to-end machine learning pipeline actually looks like, and which subtasks of the machine learning pipeline have been automated so far. We highlight those subtasks which are still done manually - generally by a data scientist - and explain how this limits domain experts' access to machine learning. Next, we introduce our novel level-based taxonomy for AutoML systems and define each level according to the scope of automation support provided. Finally, we lay out a roadmap for the future, pinpointing the research required to further automate the end-to-end machine learning pipeline and discussing important challenges that stand in the way of this ambitious goal.

📄 PDF Abstract BibTeX arXiv:2010.10777

Code (0)

등록된 구현이 없습니다.

Tasks

AutoMLBIG-bench Machine Learning

Similar Papers 제목 키워드 기반

AutoML in the Age of Large Language Models: Current Challenges, Future Opportunities and Risks

2023-06-13 · Alexander Tornede, Difan Deng, Theresa Eimer, Joseph Giovanelli 외

The fields of both Natural Language Processing (NLP) and Automated Machine Learning (AutoML) have achieved remarkable results over the past years. In NLP, especially Large Language Models (LLMs) have experienced a rapid …

AutoML

The Technological Emergence of AutoML: A Survey of Performant Software and Applications in the Context of Industry

2022-11-08 · Alexander Scriven, David Jacob Kedziora, Katarzyna Musial, Bogdan Gabrys

With most technical fields, there exists a delay between fundamental academic research and practical industrial uptake. Whilst some sciences have robust and well-established processes for commercialisation, such as the p…

AutoML

Can Fairness be Automated? Guidelines and Opportunities for Fairness-aware AutoML

2023-03-15 · Hilde Weerts, Florian Pfisterer, Matthias Feurer, Katharina Eggensperger 외

The field of automated machine learning (AutoML) introduces techniques that automate parts of the development of machine learning (ML) systems, accelerating the process and reducing barriers for novices. However, decisio…

AutoMLFairness

What Can AutoML Do For Continual Learning?

2023-11-20 · Mert Kilickaya, Joaquin Vanschoren

This position paper outlines the potential of AutoML for incremental (continual) learning to encourage more research in this direction. Incremental learning involves incorporating new data from a stream of tasks and dist…

AutoMLContinual LearningIncremental Learning

Automated Machine Learning -- a brief review at the end of the early years

2020-08-19 · Hugo Jair Escalante

Automated machine learning (AutoML) is the sub-field of machine learning that aims at automating, to some extend, all stages of the design of a machine learning system. In the context of supervised learning, AutoML is co…

AutoMLBIG-bench Machine Learning