Hyperopt-Sklearn: Automatic Hyperparameter Configuration for Scikit-Learn
Hyperopt-sklearn is a new software project that provides automatic algorithm configuration of the Scikit-learn machine learning library. Following Auto-Weka, we take the view that the choice of classifier and even the choice of preprocessing module can be taken together to represent a single large hyperparameter optimization problem. We use Hyperopt to define a search space that encompasses many standard components (e.g. SVM, RF, KNN, PCA, TFIDF) and common patterns of composing them together. We demonstrate, using search algorithms in Hyperopt and standard benchmarking data sets (MNIST, 20-Newsgroups, Convex Shapes), that searching this space is practical and effective. In particular, we improve on best-known scores for the model space for both MNIST and Convex Shapes.
Code (2)
Tasks
AutoMLBenchmarkingHyperparameter OptimizationMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
Type-Driven Automated Learning with Lale
Machine-learning automation tools, ranging from humble grid-search to hyperopt, auto-sklearn, and TPOT, help explore large search spaces of possible pipelines. Unfortunately, each of these tools has a different syntax fo…
Time SeriesTime Series AnalysisVocal Bursts Type PredictionHyperparameter Tuning Cookbook: A guide for scikit-learn, PyTorch, river, and spotPython
This document provides a comprehensive guide to hyperparameter tuning using spotPython for scikit-learn, PyTorch, and river. The first part introduces spotPython's surrogate model-based optimization process, while the se…
Efficient and Robust Automated Machine Learning
The success of machine learning in a broad range of applications has led to an ever-growing demand for machine learning systems that can be used off the shelf by non-experts. To be effective in practice, such systems nee…
AutoMLBayesian OptimizationBIG-bench Machine LearningHyperparameter OptimizationCHOPT : Automated Hyperparameter Optimization Framework for Cloud-Based Machine Learning Platforms
Many hyperparameter optimization (HyperOpt) methods assume restricted computing resources and mainly focus on enhancing performance. Here we propose a novel cloud-based HyperOpt (CHOPT) framework which can efficiently ut…
BIG-bench Machine LearningHyperparameter OptimizationQuestion AnsweringMANGO: A Python Library for Parallel Hyperparameter Tuning
Tuning hyperparameters for machine learning algorithms is a tedious task, one that is typically done manually. To enable automated hyperparameter tuning, recent works have started to use techniques based on Bayesian opti…
Bayesian OptimizationBIG-bench Machine LearningDistributed ComputingDistributed Optimization+2