paper-with-me

홈 › Papers

VEGA: Towards an End-to-End Configurable AutoML Pipeline

2020-11-03 · Bochao Wang, Hang Xu, Jiajin Zhang, Chen Chen, Xiaozhi Fang, Yixing Xu, Ning Kang, Lanqing Hong, Chenhan Jiang, Xinyue Cai, Jiawei Li, Fengwei Zhou, Yong Li, Zhicheng Liu, Xinghao Chen, Kai Han, Han Shu, Dehua Song, Yunhe Wang, Wei zhang, Chunjing Xu, Zhenguo Li, Wenzhi Liu, Tong Zhang

Automated Machine Learning (AutoML) is an important industrial solution for automatic discovery and deployment of the machine learning models. However, designing an integrated AutoML system faces four great challenges of configurability, scalability, integrability, and platform diversity. In this work, we present VEGA, an efficient and comprehensive AutoML framework that is compatible and optimized for multiple hardware platforms. a) The VEGA pipeline integrates various modules of AutoML, including Neural Architecture Search (NAS), Hyperparameter Optimization (HPO), Auto Data Augmentation, Model Compression, and Fully Train. b) To support a variety of search algorithms and tasks, we design a novel fine-grained search space and its description language to enable easy adaptation to different search algorithms and tasks. c) We abstract the common components of deep learning frameworks into a unified interface. VEGA can be executed with multiple back-ends and hardwares. Extensive benchmark experiments on multiple tasks demonstrate that VEGA can improve the existing AutoML algorithms and discover new high-performance models against SOTA methods, e.g. the searched DNet model zoo for Ascend 10x faster than EfficientNet-B5 and 9.2x faster than RegNetX-32GF on ImageNet. VEGA is open-sourced at https://github.com/huawei-noah/vega.

📄 PDF Abstract BibTeX arXiv:2011.01507

Code (1)

huawei-noah/vega 공식 구현 tf

Tasks

AutoMLBIG-bench Machine LearningData AugmentationDiversityHyperparameter OptimizationModel CompressionNeural Architecture Search

Methods 이 논문이 사용한 방법론

VEGA 설명 없음

Similar Papers 제목 키워드 기반

XAutoML: A Visual Analytics Tool for Understanding and Validating Automated Machine Learning

2022-02-24 · Marc-André Zöller, Waldemar Titov, Thomas Schlegel, Marco F. Huber

In the last ten years, various automated machine learning (AutoM ) systems have been proposed to build end-to-end machine learning (ML) pipelines with minimal human interaction. Even though such automatically synthesized…

AutoMLBIG-bench Machine LearningExplainable artificial intelligenceExplainable Artificial Intelligence (XAI)

SubStrat: A Subset-Based Strategy for Faster AutoML

2022-06-07 · Teddy Lazebnik, Amit Somech, Abraham Itzhak Weinberg

Automated machine learning (AutoML) frameworks have become important tools in the data scientists' arsenal, as they dramatically reduce the manual work devoted to the construction of ML pipelines. Such frameworks intelli…

AutoMLFeature EngineeringModel Selection

AutoML in Heavily Constrained Applications

2023-06-29 · Felix Neutatz, Marius Lindauer, Ziawasch Abedjan

Optimizing a machine learning pipeline for a task at hand requires careful configuration of various hyperparameters, typically supported by an AutoML system that optimizes the hyperparameters for the given training datas…

AutoMLMeta-Learning

A Scalable AutoML Approach Based on Graph Neural Networks

2021-10-29 · Mossad Helali, Essam Mansour, Ibrahim Abdelaziz, Julian Dolby 외

AutoML systems build machine learning models automatically by performing a search over valid data transformations and learners, along with hyper-parameter optimization for each learner. Many AutoML systems use meta-learn…

AutoMLGraph GenerationMeta-Learningvalid

Pipeline Combinators for Gradual AutoML

2021-12-01 · NeurIPS 2021 12 · Guillaume Baudart, Martin Hirzel, Kiran Kate, Parikshit Ram 외

Automated machine learning (AutoML) can make data scientists more productive. But if machine learning is totally automated, that leaves no room for data scientists to apply their intuition. Hence, data scientists often…

AutoMLBIG-bench Machine LearningTranslation