Replacing the Ex-Def Baseline in AutoML by Naive AutoML
Automated Machine Learning (AutoML) is the problem of automatically finding the pipeline with the best generalization performance on some given dataset. AutoML has received enormous attention in the last decade and has been addressed with sophisticated black-box optimization techniques like Bayesian Optimization, Genetic Algorithms, or Tree Search. These approaches are almost never compared to simple baselines to see how much they improve over simple but easy to implement approaches. We present Naive AutoML, a very simple baseline for AutoML that exploits meta-knowledge about machine learning problems and makes simplifying, yet, effective assumptions to quickly come to high-quality solutions. In 1h experiments, state of the art approaches can hardly improve over Naive AutoML which in turn comes along with advantages such as interpretability and flexibility.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBayesian OptimizationBIG-bench Machine LearningSimilar Papers 제목 키워드 기반
Naive Automated Machine Learning -- A Late Baseline for AutoML
Automated Machine Learning (AutoML) is the problem of automatically finding the pipeline with the best generalization performance on some given dataset. AutoML has received enormous attention in the last decade and has b…
AutoMLBayesian OptimizationBIG-bench Machine LearningThe Potential of AutoML for Recommender Systems
Automated Machine Learning (AutoML) has greatly advanced applications of Machine Learning (ML) including model compression, machine translation, and computer vision. Recommender Systems (RecSys) can be seen as an applica…
AutoMLMachine TranslationModel CompressionRecommendation SystemsAutoML-Based Drought Forecast with Meteorological Variables
A precise forecast for droughts is of considerable value to scientific research, agriculture, and water resource management. With emerging developments of data-driven approaches for hydro-climate modeling, this paper inv…
AutoMLDeep LearningManagementXAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learning
In the last ten years, various automated machine learning (AutoM ) systems have been proposed to build end-to-end machine learning (ML) pipelines with minimal human interaction. Even though such automatically synthesized…
AutoMLBIG-bench Machine LearningExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)AutoML for Large Capacity Modeling of Meta's Ranking Systems
Web-scale ranking systems at Meta serving billions of users is complex. Improving ranking models is essential but engineering heavy. Automated Machine Learning (AutoML) can release engineers from labor intensive work of …
AutoMLHyperparameter OptimizationNeural Architecture Search