paper-with-me

Papers

Hyperopt-Sklearn: Automatic Hyperparameter Configuration for Scikit-Learn

2014-01-01 · SCIPY 2014 2014 1 · Brent Komer, James Bergstra, Chris Eliasmith

Hyperopt-sklearn is a new software project that provides automatic algorithm configuration of the Scikit-learn machine learning library. Following Auto-Weka, we take the view that the choice of classifier and even the choice of preprocessing module can be taken together to represent a single large hyperparameter optimization problem. We use Hyperopt to define a search space that encompasses many standard components (e.g. SVM, RF, KNN, PCA, TFIDF) and common patterns of composing them together. We demonstrate, using search algorithms in Hyperopt and standard benchmarking data sets (MNIST, 20-Newsgroups, Convex Shapes), that searching this space is practical and effective. In particular, we improve on best-known scores for the model space for both MNIST and Convex Shapes.

📄 PDF Abstract BibTeX

Code (2)

hyperopt/hyperopt-sklearn
jim-schwoebel/allie pytorch

Tasks

AutoMLBenchmarkingHyperparameter Optimization

Methods 이 논문이 사용한 방법론

SVM A Support Vector Machine, or SVM, is a non-parametric supervised learning model. For non-linear classification and regression, they utilise the kernel trick to map inputs…
PCA Principle Components Analysis (PCA) is an unsupervised method primary used for dimensionality reduction within machine learning. PCA is calculated via a singular value…

Similar Papers 제목 키워드 기반

Type-Driven Automated Learning with Lale

2019-05-24 · Martin Hirzel, Kiran Kate, Avraham Shinnar, Subhrajit Roy 외

Machine-learning automation tools, ranging from humble grid-search to hyperopt, auto-sklearn, and TPOT, help explore large search spaces of possible pipelines. Unfortunately, each of these tools has a different syntax fo…

Time SeriesTime Series AnalysisVocal Bursts Type Prediction

Hyperparameter Tuning Cookbook: A guide for scikit-learn, PyTorch, river, and spotPython

2023-07-17 · Thomas Bartz-Beielstein

This document provides a comprehensive guide to hyperparameter tuning using spotPython for scikit-learn, PyTorch, and river. The first part introduces spotPython's surrogate model-based optimization process, while the se…

Efficient and Robust Automated Machine Learning

2015-12-01 · NeurIPS 2015 12 · Matthias Feurer, Aaron Klein, Katharina Eggensperger, Jost Springenberg 외

The success of machine learning in a broad range of applications has led to an ever-growing demand for machine learning systems that can be used off the shelf by non-experts. To be effective in practice, such systems nee…

AutoMLBayesian OptimizationBIG-bench Machine LearningHyperparameter Optimization

CHOPT : Automated Hyperparameter Optimization Framework for Cloud-Based Machine Learning Platforms

2018-10-08 · Jinwoong Kim, Minkyu Kim, Heungseok Park, Ernar Kusdavletov 외

Many hyperparameter optimization (HyperOpt) methods assume restricted computing resources and mainly focus on enhancing performance. Here we propose a novel cloud-based HyperOpt (CHOPT) framework which can efficiently ut…

BIG-bench Machine LearningHyperparameter OptimizationQuestion Answering

MANGO: A Python Library for Parallel Hyperparameter Tuning

2020-05-22 · Sandeep Singh Sandha, Mohit Aggarwal, Igor Fedorov, Mani Srivastava

Tuning hyperparameters for machine learning algorithms is a tedious task, one that is typically done manually. To enable automated hyperparameter tuning, recent works have started to use techniques based on Bayesian opti…

Bayesian OptimizationBIG-bench Machine LearningDistributed ComputingDistributed Optimization+2