Transferable AutoML by Model Sharing Over Grouped Datasets
Automated Machine Learning (AutoML) is an active area on the design of deep neural networks for specific tasks and datasets. Given the complexity of discovering new network designs, methods for speeding up the search procedure are becoming important. This paper presents a so-called transferable AutoML approach that Automated Machine Learning (AutoML) is an active area on the design of deep neural networks for specific tasks and datasets. Given the complexity of discovering new network designs, methods for speeding up the search procedure are becoming important. This paper presents a so-called transferable AutoML approach that leverages previously trained models to speed up the search process for new tasks and datasets. Our approach involves a novel meta-feature extraction technique based on the performance of benchmark models, and a dynamic dataset clustering algorithm based on Markov process and statistical hypothesis test. As such multiple models can share a common structure while with different learned parameters. The transferable AutoML can either be applied to search from scratch, search from predesigned models, or transfer from basic cells according to the difficulties of the given datasets. The experimental results on image classification show notable speedup in overall search time for multiple datasets with negligible loss in accuracy.
Code (0)
등록된 구현이 없습니다.
Tasks
AutoMLBIG-bench Machine LearningClusteringimage-classificationImage ClassificationmodelMethods 이 논문이 사용한 방법론
Similar Papers 제목 키워드 기반
The Potential of AutoML for Recommender Systems
Automated Machine Learning (AutoML) has greatly advanced applications of Machine Learning (ML) including model compression, machine translation, and computer vision. Recommender Systems (RecSys) can be seen as an applica…
AutoMLMachine TranslationModel CompressionRecommendation SystemsFederated Whole Prostate Segmentation in MRI with Personalized Neural Architectures
Building robust deep learning-based models requires diverse training data, ideally from several sources. However, these datasets cannot be combined easily because of patient privacy concerns or regulatory hurdles, especi…
AutoMLFederated LearningNeural Architecture SearchAutoML from Service Provider's Perspective: Multi-device, Multi-tenant Model Selection with GP-EI
AutoML has become a popular service that is provided by most leading cloud service providers today. In this paper, we focus on the AutoML problem from the \emph{service provider's perspective}, motivated by the following…
AutoMLModel SelectionA Scalable AutoML Approach Based on Graph Neural Networks
AutoML systems build machine learning models automatically by performing a search over valid data transformations and learners, along with hyper-parameter optimization for each learner. Many AutoML systems use meta-learn…
AutoMLGraph GenerationMeta-LearningvalidAuto-Sklearn 2.0: Hands-free AutoML via Meta-Learning
Automated Machine Learning (AutoML) supports practitioners and researchers with the tedious task of designing machine learning pipelines and has recently achieved substantial success. In this paper, we introduce new Auto…
AutoMLBIG-bench Machine LearningMeta-Learning