paper-with-me

홈 › Papers

AutoML: A Survey of the State-of-the-Art

2019-08-02 · Xin He, Kaiyong Zhao, Xiaowen Chu

Deep learning (DL) techniques have penetrated all aspects of our lives and brought us great convenience. However, building a high-quality DL system for a specific task highly relies on human expertise, hindering the applications of DL to more areas. Automated machine learning (AutoML) becomes a promising solution to build a DL system without human assistance, and a growing number of researchers focus on AutoML. In this paper, we provide a comprehensive and up-to-date review of the state-of-the-art (SOTA) in AutoML. First, we introduce AutoML methods according to the pipeline, covering data preparation, feature engineering, hyperparameter optimization, and neural architecture search (NAS). We focus more on NAS, as it is currently very hot sub-topic of AutoML. We summarize the performance of the representative NAS algorithms on the CIFAR-10 and ImageNet datasets and further discuss several worthy studying directions of NAS methods: one/two-stage NAS, one-shot NAS, and joint hyperparameter and architecture optimization. Finally, we discuss some open problems of the existing AutoML methods for future research.

📄 PDF Abstract BibTeX arXiv:1908.00709

Code (2)

marsggbo/automl_a_survey_of_state_of_the_art 공식 구현
daya6489/DriveML

Tasks

AutoMLFeature EngineeringHyperparameter OptimizationNeural Architecture SearchSurvey

Methods 이 논문이 사용한 방법론

Sigmoid Activation 설명 없음
Tanh Activation 설명 없음
Softmax The Softmax output function transforms a previous layer's output into a vector of probabilities. It is commonly used for multiclass classification. Given an input vector $x$…
LSTM An LSTM is a type of recurrent neural network that addresses the vanishing gradient problem in vanilla…

Similar Papers 제목 키워드 기반

Benchmark and Survey of Automated Machine Learning Frameworks

2019-04-26 · Marc-André Zöller, Marco F. Huber

Machine learning (ML) has become a vital part in many aspects of our daily life. However, building well performing machine learning applications requires highly specialized data scientists and domain experts. Automated m…

AutoMLBIG-bench Machine LearningSurvey

A Comprehensive Survey on Automated Machine Learning for Recommendations

2022-04-04 · Bo Chen, Xiangyu Zhao, Yejing Wang, Wenqi Fan 외

Deep recommender systems (DRS) are critical for current commercial online service providers, which address the issue of information overload by recommending items that are tailored to the user's interests and preferences…

AutoMLBIG-bench Machine Learningfeature selectionRecommendation Systems+1

The Technological Emergence of AutoML: A Survey of Performant Software and Applications in the Context of Industry

2022-11-08 · Alexander Scriven, David Jacob Kedziora, Katarzyna Musial, Bogdan Gabrys

With most technical fields, there exists a delay between fundamental academic research and practical industrial uptake. Whilst some sciences have robust and well-established processes for commercialisation, such as the p…

AutoML

Automated Machine Learning on Graphs: A Survey

2021-03-01 · Ziwei Zhang, Xin Wang, Wenwu Zhu

Machine learning on graphs has been extensively studied in both academic and industry. However, as the literature on graph learning booms with a vast number of emerging methods and techniques, it becomes increasingly dif…

AutoMLBIG-bench Machine LearningGraph LearningNeural Architecture Search+1

Automated Machine Learning: From Principles to Practices

2018-10-31 · Zhenqian Shen, Yongqi Zhang, Lanning Wei, Huan Zhao 외

Machine learning (ML) methods have been developing rapidly, but configuring and selecting proper methods to achieve a desired performance is increasingly difficult and tedious. To address this challenge, automated machin…

AutoMLBIG-bench Machine LearningNeural Architecture SearchSurvey